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ALGORITHMS FOR NON-LINEAR AND STOCHASTIC RESOURCE 
CONSTRAINED SHORTEST PATH. 

AXEL PARMENTIER 


Abstract. Resource constrained shortest path problems are usually solved thanks to a smart 
enumeration of all the non-dominated paths. Recent improvements of these enumeration algorithms 
rely on the use of bounds on path resources to discard partial solutions. The quality of the bounds 
determines the performance of the algorithm. The main contribution of this paper is to introduce 
a standard procedure to generate bounds on paths resources in a general setting which covers most 
resource constrained shortest path problems, among which stochastic versions. 

In that purpose, we introduce a generalization of the resource constrained shortest path prob¬ 
lem where the resources are taken in a monoid. The resource of a path is the monoid sum of 
the resources of its arcs. The problem consists in finding a path whose resource minimizes a non¬ 
decreasing cost function of the path resource among the paths that respect a given constraint. 
Enumeration algorithms are generalized to this framework. We use lattice theory to provide poly¬ 
nomial procedures to find good quality bounds. These procedures solve a generalization of the 
algebraic path problem, where arc resources belong to a lattice ordered monoid. The practical 
efficiency of the approach is proved through an extensive numerical study on some deterministic 
and stochastic resource constrained shortest path problems. 


1. Introduction 

1.1. Problem statement. Several methods have recently been developed to increase the efficiency 
of the shortest path problem solvers [1] . A common feature to all these methods is the use of lower 
bounds on costs of paths to discard partial paths in an enumeration of all the paths. In this paper, 
we exploit the properties of lattices to extend this lower bound idea to algorithms for a generic 
version of the resource constrained shortest path problem where arc resources belong to a lattice 
ordered monoid. The lattice ordered monoid point of view covers a wide range of applications, 
among which stochastic versions of the resource constrained shortest path problem. 

Let (7^, and (5, <) be two partially ordered sets. A map p : TZ ^ S is isotone if x ^ y implies 
p{x) < p{y)- Let (7^,0) be a set endowed with a law of composition. (7^,0) is a monoid if 0 is 
associative and admits a neutral element in TZ. A partial order ^ is a compatible order on (TZ, 0) 
if all translations y i-)- x 0 y and y i-)- y 0 x are isotone. An ordered monoid (TZ, 0, is a monoid 
endowed with a compatible order. A partially ordered set {TZ, is a lattice if any pair of elements 
(x, x) of TZ^ admits a greatest lower bound x A x or meet and a least upper bound x V x. A lattice 
ordered monoid {TZ, 0, is an ordered monoid such that ^ induces a lattice structure. 

Let {TZ, 0, be a lattice ordered monoid. Consider the following problem. 

Monoid Resource Constrained Shortest Path Problem 

Input. A digraph D = {V,A), two vertices o,d € V, a collection (xa) G TZ^, and two isotone 
mappings c : 7^ —>■ M and p : TZ ^ {0, 1}. 

Output. An o-d path P such that p (0agp Xq) = 0 and with minimum c (0Qgp Xq) ■ 

TZ is the set of resources. The resource of a path P is 0agp Xq and we denote it xp, the cost of 
P is c (0agpTa), and P is feasible if and only if p (0(jgpTa) is a equal to 0. The function p is 
later referred as the infeasibility function. 
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The Monoid Resource Constrained Shortest Path Problem is MV-h&xd as it contains 
the usual Resource Constrained Shortest Path Problem, which is obtained by using the 
set TZ = the cost c(x^,x^) = , and the function /j((x^,x^)) equal to 1 if and only if x^ > M 

for a given M G M. Finally, we emphasize that 0 is possibly non commutative. 

This lattice ordered monoid framework has two main strengths. First, it enables to deal with 
stochasticity in path problems. And second, the lattice ordered monoid structure enables to define 
polynomial procedure to compute lower bounds on paths resources, and to use these bounds to 
speed-up solution algorithms. We now sketch the main ideas behind the treatment of stochastic 
path problems and the solution schemes. 


1.2. Application to stochastic path problems. Suppose that for each arc a we have a random 
variable ^a- A large class of stochastic path problems can be expressed as follows. Given an origin 
vertex o and a destination d, find an o-d path minimizing 


min IE 

P 



under the constraint 

<a, 

VaGP / 

where / is a non-decreasing function, and r and a are constants. We use two main ideas to 
model such problems within the MoNOiD RESOURCE Constrained Shortest Path Problem 
framework. First, a space of random variables endowed with the addition and the almost sure 
order is a lattice ordered monoid. And second, many if not most probability functionals that 
intervene in stochastic path problems are monotone with respect to this order and can therefore 
be modeled withing this framework. On our example, it suffices to define Xa = Ca, c(^) = IE [/(.^)], 
and p{^) = l(a,i](lF’(X]aeP^ ^ where we introduce the notation 1/ that we frequently use in 
the paper to denote the indicator function of a set I. 

Finally, the use of alternative stochastic orders enables to exploit assumptions such as the inde¬ 
pendence of the to improve the performance of our solution algorithms. 


1.3. Solution scheme. We propose solution schemes for the Monoid Resource Constrained 
Shortest Path Problem when Xa ^ 0 for each cycle C in D. These schemes are in two 

steps. We start by computing for each vertex v a lower bound on the resource xp of all the v-d 
paths. Then, we use these lower bounds to discard partial solutions in an enumeration of all the 
paths. 

Bounds are used in enumeration algorithms to compute lower bounds on the resource of any 
o-d path starting by an o-v path P. Indeed, given an o-v path P and a v-d path P, 

Xp ^ Xp ® Xp = Xppp, 

where P -\- P denotes the path composed of P followed by P. The resource xp (B by is therefore a 
lower bound on the resource of any o-d path starting by P. As p and c are isotone, p{xp © 6„) = 1 
implies that there is no feasible o-d path starting by P, and c(xp 0 by) is a lower bound on the cost 
of any o-d path P starting by P. The enumeration algorithm we propose therefore enumerates all 
the paths satisfying 

(1) p{xp®by) = 0 and c(xp © 6^,) < c^/, 

where v is the destination of P and is an upper bound on the cost of an optimal solution. 

The practical efficiency of the approach relies on our ability to compute in a preprocessing a tight 
lower bound on the resource of all the v-d paths. As {TZ, is a lattice, the meet by^^ = Apgp ^ ^jp, 
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where Vvd denotes the set of v-d paths, is the tightest lower bound. Indeed, by definition of the 
meet, 

by ^ xp for all P in Vyd ^ b ^ xp. 

Unfortunately, we have shown 0 that, unless V = AfV, there is no polynomial algorithm that 
enables to compute 6°^* in polynomial time even on some simple lattice ordered monoid where 
resources are positive. However, we provide polynomial procedures that compute lower bounds 
on 6°'’*. To that purpose, we show that the following equation always admits solutions, that its 
solutions are lower bounds on 6°'’*, and we introduce polynomial procedures that compute its 
greatest solution. 

r bd = o, 

(2) < by = b,A A {x{v,u) ® bu) for all V € U\{d}. 

{v,u)£S+{v) 

Note that Equation ([2]) can be interpreted as a generalization of the Ford-Bellman dynamic pro¬ 
gramming equation for the usual shortest path problem, where the minimum has been replaced by 
the meet operator A, and the sum by the operator ©. Our polynomial procedures are generalizations 
of the Ford-Bellman and of the Dijkstra algorithm for the usual shortest path problem. 

1.4. Contributions and plan. We can sum-up our contributions as follows: 

• We introduce a versatile algebraic framework for constrained shortest path problems. This 
framework notably enables to deal with non-linearity and stochasticity in the objective and 
in the constraints. 

• We provide polynomial procedures to compute the solution of the generalized dynamic 
programming equation ©• The problem of solving this equation when the resource set 
has the structure of idempotent semiring is known as the algebraic path problem and has 
received much attention. Our procedures extend well-known algorithms of this community 
to the more general setting of lattice ordered monoids. Besides, contrary to the algebraic 
path problem community, we do not interpret the solution of ([T]) as the solution of the 
problem but as lower bounds that can then be used in an enumeration algorithm. This new 
interpretation together with the extension to lattice ordered monoids enable to apply these 
algebraic methods to a much wider range of paths problems. The lattice ordered monoid 
point of view is notably essential to model stochastic path problems. 

• We generalize the usual enumeration algorithms for resource constrained shortest path 
problems to our framework. The use of bounds is these algorithms is easy thanks to the 
lattice ordered monoid structure. 

• Concerning stochastic path problems, we show that our framework can deal with most 
probability functionals of interest, among which the version independent risk measures. 
Besides, we can deal with a wide range of probability distributions for the random variables 

and we can solve approximated versions of problems with other distribution through 
sampling. 

• We show the practical efficiency of our approach through extensive numerical experiments 
on deterministic and stochastic resource constrained shortest path problems. To the best 
of our knowledge, our algorithms are the first practically efficient ones for paths problems 
with probabilistic constraints. 

• Finally, we provide strategies to improve the performance of our enumeration algorithms 
on difficult problems thanks to a longer preprocessing. 

After introducing some notions on digraphs and ordered algebraic structures in Section [21 we 
detail the connections between our framework and algorithms and those of the literature on usual, 
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algebraic, resource constrained, and stochastic path problems in Section [3l Sections 0] and [5] in¬ 
troduce respectively our enumeration and bounding algorithms for the Monoid Resource Con¬ 
strained Shortest Path Problem. Section [6] tests the numerical performance of our algorithms 
on instances of the usual resource constrained shortest path problem. In Section [71 we explain how 
to model stochastic path problems within our framework, and test numerically the performance of 
our algorithm on some non-constrained and constrained stochastic path problems. We conclude 
the paper with techniques to improve the performance of our algorithms on difficult instances in 
Section [8l 


2. Preliminaries 

2.1. Digraphs. A digraph D is a pair {V, A), where V is the set of vertices and A is the set of arcs 
of D. An arc a links a tail vertex to a head vertex. An arc a is incoming to (resp. outgoing from) v 
if V is the head (resp. the tail) of v. The set of arcs incoming to (resp. outgoing from) v is denoted 
5~{v) (resp. (5''“(u)). A path is a sequence of arcs oi,..., such that for each i € {1,..., /c — 1}, 
the head vertex of Oj is the tail vertex of Oj+i. Note that with this definition, paths can contain 
multiple copies of an arc or of a vertex. A path P is said to be elementary if it contains at most 
one copy of each vertex. The origin of a path it the tail of its first arc and its destination is the 
head of its last arc. Given two vertices o and d in V, an o-d path P is a path with origin o and 
destination d. Finally, a cycle is a path whose origin is identical to its destination. 

Given two paths P and Q such that P ends in the origin of Q, we denote P + Q the path made 
of P followed by Q. Given two vertices u and v, we denote Vuv the set of u-v paths. 

2.2. Lattice ordered monoids and algebraic structures. We now introduce additional prop¬ 
erties on lattices. When a subset 5 of a partially ordered set admits a greatest lower bound (resp. a 
least upper bound), we again call it its meet (resp. its join), and denote it /\ 5* or Axes ® (resp. V S 
or VxeS^)- finite subset of a lattice admits a meet and a join. A lattice is complete if any 
subset S CTZ admits a meet and a join. It is conditionally complete if any bounded subset S CTZ 
admits a meet and a join. 

(3) All the lattices we consider in this paper are conditionally complete. 

If TZ is conditionally complete, then TZ U {—oo,-|-oo} is complete, where —oo (resp. -|-oo) is 
smaller (resp. greater) than any element in TZ. The lattice TZU {—oo,-|-oo} is a completion of TZ. 
We sometimes need our lattices to be complete to be able to define some quantities needed in the 
paper. When such quantities are defined, we mention that they may belong to the completion 
TZ U {—oo, -|-oo} of TZ. 

We denote 0 the neutral element of the operator © of a lattice ordered monoid (7^,®,^). A 
resource x is positive if x > 0. A lattice ordered monoid (7^,©,^) is a lattice ordered group if 
(TZ, ©) is a group. A lattice ordered group is Archimedean if, for each x,x € TZ such that x > 0, 
there exists n in Z+ such that nx ^ x, where nx = x © • • • © x. 

'-V-' 

n times 

3. Literature review 

As an algebraic framework for non-linear and stochastic resource constrained shortest path prob¬ 
lems, our work is at the cross-road of several branches of the literature. First, our algorithms are 
naturally interpreted as generalizations of the usual shortest path problem algorithms. Second, 
our bounding algorithms are generalizations to lattice ordered monoids of those of the algebraic 
path problem community. Third, our framework can be seen as a versatile alternative to other re¬ 
source constrained shortest path framework with enhanced version of the enumeration algorithms. 
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Finally, the restriction of our algorithms to stochastic path problems compare favorably to the 
existing literature on the topic. 


3.1. Usual shortest path problem. Variants of the Shortest Path Problem have been thor¬ 
oughly studied during the last six decades. As we already mentioned, there are two main types 
of algorithms for the SHORTEST Path Problem. The first ones, such as Dijkstra’s algorithm or 
Ford-Bellman algorithm, compute the shortest path between one vertex and all the other ones. In 
that sense their output is a solution of the dynamic programming equation ([2]) where 0 is the usual 
sum on M and the meet A is the minimum. The standard algorithm to solve it is Dijkstra’s algo¬ 
rithm [2^ when arcs costs are non-negative, and Ford-Bellman 0,0 when they can be negative. 
We generalize both of them to compute solutions of ([2]). 

The second ones are enumeration algorithms and use bounds to discard paths in an enumeration 
of all the paths. The typical example of enumeration algorithm is A* algorithm [0], that we 
generalize to our setting. These algorithms are called goal directed algorithms as they compute 
the shortest path only between a given pair of origin and destination vertices. When good bounds 
are used, enumeration algorithms are faster than polynomial algorithms. Bast et al. survey the 
rich literature developed in the last few years on the topic in the context of online route planning 
systems. However, the goals of these recent contributions are orthogonal to our ones: their objective 
is to be able to compute quickly the solution of an easy path problem between any o-d pair, while 
we want to compute the solution of a difficult problem between one given o-d pair. 


3.2. Bounding algorithms and algebraic path problems. Equation ([2]) is not the first gen¬ 
eralization of the usual dynamic programming equation. Indeed, when (7^, A,0) is an idempotent 
semiring, the problem of solving Equation ([2]) is called the algebraic path problem. The literature 
on the topic considers idempotent semirings of various generality 0, m M, 113, Ei, lei, Ei, [H 
and is surveyed in [s^. Our framework generalizes the algebraic path problem; the idempotent 
semiring structure is stronger than the lattice ordered monoid one. Indeed, if {TZ, 0, x) is an idem- 
potent semiring, then (TZ, x, ^_|_) is a lattice ordered monoid, where is the idempotent semiring 
canonical order: x x if and only x + x = x. Its meet operator is 0. In the other direction, 
if (7^,©,^) is a lattice ordered monoid with meet operator A, then (7^, A,©) is an idempotent 
semiring if and only if © distributes with respect to A, i.e. 


a © (6 A c) = (a © 6) A (a © c) and (a A 6) © c = (a © 6) A (a © c). 

If bl is not necessarily equal to 6°^* on lattice ordered monoids, these two quantities are equal on 
idempotent semirings. 

Two types of algorithms have been developed for the algebraic 
eralize respectively the Eord-Bellman [2 


)ath problem. The first ones gen- 
23| and the Dijkstra [65l | algorithm. Our algorithms can 


be seen as generalization to the lattice ordered monoid setting of these algorithms. Our generalized 
Dijkstra algorithm is in particular very similar to the one developed by Mohri [^. Therefore, 
we can use results from the algebraic path problem community to obtain stronger versions of our 
convergence theorems when © distributes with respect to A. The second type of algorithms for the 
algebraic path problem consider Equation ([2]) as a system of linear equations in the idempotent 
semi ring (7^ , ©, <), and generalize the Gauss-Seidel and the Gauss-Jordan algorithms to that set¬ 
ting [4d. l84|. Unfortunately, these algorithms do not generalize well to the lattice ordered monoid 
setting. 

Einally, we present in Section [8] a technique to improve the quality of bounds that builds a lower 
envelope on the set {x € TZ\xp 0 x for some P in T^^d}- Techniques to build such a lower envelope 
have recently been proposed [J, [st] in the context of static program analysis. However, their process 
for building the lower envelope is orthogonal to our one. 
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3.3. Enumeration algorithms and resource constrained shortest path problems. Irnich 
& Desaulniers [H] provide a resource constrained shortest path framework and survey the exact and 
heuristic approaches to resource constrained shortest path problems. Their resource constrained 


shortest path framework is based on the notion of resource extension functions : there is one such 
function (a for each arc a, and the resource of a path formed of the arcs ai,..., is Ca^. o... (0). 

The main difference between their framework and our one is the associativity of 0. This makes our 
framework slightly less versatile, but enables us to compute lower bounds on paths resources and 
to use them to speed up the resolution. Besides, most problems of the literature can be modeled 
within our framework, as we argue in Chapter 3 of 0. 

There are three main types of exact solution schemes to solve resource constrained shortest path 
problems: constraint programming, branch and bound, and enumeration algorithms. Constraint 
programming approaches [1^, 31, 1 


5,x |75[ combine specihcally designed search, domain reduc¬ 


tion, and propagation algorithms. Concerning Branch-and-Bound algorithms, specific branching 
patterns have been developed by branch and bound algorithms for resource constrained shortest 
path problems: they branch on cycles, on arcs, and on resources d, [H, 113, [ 73 . Finally, our work 
enters in the field of enumeration algorithms, and we now detail the literature on that topic. 

In their survey on resource constrained shortest path problems, Irnich & Desaulniers describe 
the enumeration algorithms of the literature as variants of a generic enumeration algorithm. This 
generic enumeration algorithm has many similarities with the one we propose in Section |4l To 
obtain a practical algorithm from the generic enumeration algorithm, one must choose dehne a 
key, some bounds, and a dominance rule. The key defines which paths are processed first. The 
bounds and the dominance rules are what enable to discard paths. The dominance rule is an order 
on the set of resources that enables to discard paths whose resources are dominated. Desrochers 
&: Soumis [ 2 ^ and [tI] provide specific keys for routing problems with time windows, but these 
strategies apply to many resource constrained shortest path problems. Irnich [d^] provides general 
techniques to define resource extension functions leading to good dominance rules, and techniques 
to handle pat h with identical resources [d^. The remaining of the techniques are problem-specific 
1,113, [ 43 . l49l. 113, [13] ■ Finally, we note that variants of the enumeration algorithm based on the 
/c-shortest path problem [131 have been proposed [3, 44, [131 . These variants and problem-specific 
dominance rules can be used within our setting when appropriated. 

Several techniques have been proposed to compute bounds when (JZ, ©, is M"’ endowed with its 
product order and sum. Some contributions solve a usual shortest path problem for each component 
of the resource (23. 53, [131 ■ Another branch of the literature uses Lagrangian relaxation on an 

integer formulation of the problem to obtain lower bounds [8o| . These methods require 


the absence of negative cost cycles, in order to be able to solve the Langrangian relaxation using 
a shortest path problem. The case with negative cost cycles is considered by Feillet et al. |13|. 
When (77., ©, is M”, these Lagrangian techniques provide bounds that are typically tighter than 
our ones, but that require longer computations along the enumeration algorithm. 

The strength of our framework lies in our bounding algorithms, that enable to use lower bounds 
to discard path and good keys in non-linear and stochastic settings. 


3.4. Stochastic path problems. There are two types of stochastic path problems: offline prob¬ 
lems, where the entire path is chosen a priori, and online problems, whose solution is a policy that 
updates the path used given the realization of uncertainty on the first arcs. Given that the solution 
of the Monoid Resource Constrained Shortest Path Problem in an o-d path, it enables 
to model offline stochastic path problems. However, interestingly, the lower bounds computed in 
our framework provide ar i op timal p olicy 0 for the well-studied online stochastic on time arrival 

problem [33, [35, [33, [33, SE [33, 0, 0^- We now review the approaches to the different offline 

stochastic path problems. 
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Stochastic shortest path problems without constraints have been extensively studied since the 
seminal work of Frank [^. Models differ by the type of distribution they use for arc random 
variables, and by the probability functional they optimize. The objective of a first line of paper is 
to find a path maximizing the probability of on time arrival, or analogously, a path with minimum 
quantile of given order. Approaches have been developed for both continuous [H, [13, m, 0 
and discrete [g^ distributions. Chen et al. (2ol | describe an efficient labeling algorithm to deal 
with normal distributions on the arcs. This algorithm is not so far from our label correcting 
algorithm applied with the lattice ordered monoid presented in Section 5.1.2 of 71| when restricted 
to /?(•) = P(' > r). A second line of papers defines a shortest path as a path minimizing the 


expectation of a cost function |6ll |. Dynamic programming can be used when cost functions are 
affine or exponential (j^ . Murthy &: Sarkar [13, 67] present an efficient labeling algorithm when arc 
distributions are normal and cost functions are piecewise-linear and concave. All these objective 
functions are isotone with respect to the stochastic orders we use and can therefore be modeled 
within the MONOID RESOURCE CONSTRAINED SHORTEST PATH PROBLEM framework. Besides, 
we show in Section [3 that we can also model version independent risk measures. Concerning the 
distributions, our approach can handle all the distributions used in the literature, among which 
discrete, normal, and gamma distributions for independent random variables, and scenario based 
distributions for non-independent random variables. In this paper, we focus on discrete independent 
distributions and scenario based distributions. Lattice ordered monoids for other distributions can 
be found in Chapter 5 of (nt- The specificity of our solution approach is the use of lower bounds 
for stochastic orders. 

Our approach cannot deal with positive linear combinations of means and variances in the ob¬ 
jective [69], [to, l8l| , as these objective functions are not isotone with respect to stochastic order. 

The problem of finding a minimum cost path for deterministic arc costs under stochastic resource 
constraints have been introduced in [13], and a solution algorithm based on linear programming is 
derived. We are not aware of other approaches specifically dedicated to stochastic constraints in 
path problems. However, such problems have been considered in the context of column generation. 
A wide range of stochastic versions of the traveling salesman and the vehicle routing problems have 
been studied in the last decades. When such problems are solved by column generation, the pricing 
subproblem is a stochastic resource constrained shortest path problem. Uncertainty in customer 

have 


presence [13, [HU, in demand [13, 12, 82], and in travel time [3, [H, [13, 54 


M [13, [ 73 , 


been considered. Using the modeling techniques we introduce in Chapter 3 of [71[, most probability 
functionals considered in this literature can be dealt with using the lattice ordered monoid and the 
probability functionals presented in this chapter. However, we underline that, in the context of 
vehicle routing problems, the graph is often complete. In that case, the bounds provided by our 
approach are likely to be of poor quality, and thus our solution approach may not suit to the specific 
structure of these problems on complete graphs. 


4. Enumeration algorithms 

4.1. Generic enumeration algorithms. In this section, we give three algorithms for the Monoid 
Resource Constrained Shortest Path Problem: the generalized A*, the label dominance, 
and the label correcting algorithms. These three algorithms share the same structure. They 
enumerate all the paths in the graph using tests to discard partial paths. They differ only by the 
tests they use to discard paths, and by the keys they use to determine in which order the paths 
are processed. We therefore give a generic algorithm, and define the algorithms used in practice as 
specializations of this generic algorithm. Later in this section, we sometimes call optimal path an 
optimal solution of the Monoid Resource Constrained Shortest Path Problem. 
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Algorithm 

Test 

Key 

Pre-processing 

structures 

Maintained 

structures 

Generalized A* (A*) 
Label dominance (dom.) 
Label correcting (cor.) 

(Low) 

(Dom) 

(Dom), (Low) 

c{xp © by) 
c{xp) 
c{xp © by) 

by 

by 

T (TTB 

^od 

r cSf ,M„ 
i. <yj, 


Table 1. Monoid Resource Constrained Shortest Path Problem algorithms. 


We now describe the generic enumeration algorithm. A list L of partial paths P, and an upper 
bound on the cost of an optimal solution are maintained. Initially, L contains the empty path 
at the origin o, and = +oo. While L is not empty, the following operations are repeated. 

(1) Extract a path P of minimum “key” from L. Let v be the destination of P. 

(2) If V = d and P is feasible and better than the current solution, i.e. p{xp) = 0, and c{xp) < 

, then update to c{xp). 

(3) Else if “test” returns “yes”, extend P: for each arc a outgoing from v, add P + a to L. 

We obtain our different algorithms by specifying the key and the test respectively in the first 

and in the last step. We now introduce several keys and test. 

Our first key and test rely on lower bounds by on the resources of all the v-d paths. Section [5] 
provides polynomial algorithms to compute such bounds in a preprocessing. Given an o-v path P, 
the lower bound test is expressed as follows. 

(Low) Does P satisfy p{xp (Bby) = 0 and c{xp ®by)^ ? 

The isotony of p and c implies that a subpath P of an optimal path satisfies this test. 

An o-v path P dominates an o-v path P if xp ^ xp. The dominance test maintains along the 
algorithm a list My of non-dominated o-v paths for each vertex v, and is expressed as follows. 

(Dom) Is P non-dominated by any path in My ? 

If the answer is yes, then before extending P, we remove from My and L all the paths in My 
dominated by P, and add P to My. The rationale behind this test is that, given the way My is 
built, there is an optimal path whose subpaths are all non-dominated. 

The aim of keys is to extend first the most promising paths. As an optimal solution is a feasible 
solution of minimum cost, we use as keys estimations of the cost of an optimal path. When bounds 
by are computed, given an o-v path P, the quantity c{xp © by) provides a lower bound on the cost 
of any o-d path starting by P, and is therefore a good estimator of how promising P is. When no 
bounds are computed, we use c{xp), the cost of the partial solution considered. 

We can now describe our enumeration algorithms. The generalized A* is obtained from the 
generic algorithm by using the lower bound c{xp © by) as key in SteplH and extending a path P 
in Step [3] only if it satisfies the lower bound test (Low). When (P, ©,^) = (M,+,<), p = 0, and 
c(x) = x, it corresponds to the usual A* algorithm. The label dominance algorithm is obtained 
from the generic algorithm by using the partial path cost p{cp) as key in SteplH and extending an 
o-v path P in Step [3] only if it satisfies the dominance test (Dom). The label correcting algorithm 
is obtained from the generic algorithm by using the lower bounds c{xp (Bby) as key in SteplH and 
extending an o-v path P in Step [3] only if it satisfies both the lower bound test (Low) and the 
dominance test (Dom). 

The properties of these algorithms are summed up in Tabled} We underline fact that bounds by 
must be computed in a preprocessing when the generalized A* and the label correcting algorithms 
are used, and that the label correcting and the label dominance algorithm need to maintain lists 
of non-dominated paths My. 

Alternative combinations of our tests and keys are possible but less interesting. Indeed, our 
three algorithms reach trade-offs between the pre-processing time, and the quality of the keys and 





tests. Once bounds have been computed, performing the lower bound test (Low), and computing 
c{xp © by) require a fix number of operations ©, and A of the lattice ordered monoid. Thus, if 
time has been spent computing bounds by in a preprocessing, it is always better to use both the 
lower bound test and the key c{xp (Bby). The alternative is to use the label dominance algorithm 
to avoid spending time in the preprocessing. 

The label dominance algorithm corresponds to the standard algorithm for the resource con¬ 
strained shortest path problem in the resource extension framework. The strength of the 
Monoid Resource Constrained Shortest Path Problem framework is that it enables to 
introduce the generalized A* and the label correcting algorithms, which both rely on the use of 
bounds. 

When it comes to practical performances, it is well known that when lower bounds by can be 
computed, the label correcting algorithm outperforms the label dominance algorithm on usual 
resource constrained shortest path problems [2^. The relative performance of the generalized A* 
and of the label correcting algorithm depends on the problem considered. Indeed, the dominance 
test enables to discard more paths, but its complexity is linear in the size of My, and it may slow 
the algorithm if dominance is rare and lists My become large. This is notably the case of some 
problems with numerous or stochastic constraints. Finally, the numerical experiments in Sections 
El and [7] show that the label dominance algorithm tends to perform well on easy problems, while 
the generalized A* algorithm tends to perform better on difficult problems with many deterministic 
constraints or one stochastic constraint. 

4.2. Convergence of the algorithms. We now prove the convergence of our enumeration al¬ 
gorithms when xc ^ 0 for all the cycles C of D. When this assumption is not satisfied, these 
algorithms must be adapted to discard non-elementary paths, using for instance the techniques 
developed by Feillet et al. [s^. 

4.2.1. Generalized A* algorithm. The following assumptions will be used to define some settings 
under which ones the generalized A* algorithm converges: 

(4) For all a,b< V 77 and X > 0 in 77, there exists and n € Z_|_ such that nq® a ^b. 

There exists a feasible o-d path P such that c~^ {{—oo, c{xp)]) n /O~^(0) is upper-bounded by 
^ a resource xm < Mn. 

In Assumptions ([4]) and dS]), V 77 may be in the completion of 77. Assumption ([3]) is a weaker 
version for ordered monoid of the Archimedean property. It is satisfied by all the lattice ordered 
monoids considered in this paper. endowed with its product sum and order is an example 
of lattice ordered group that is not Archimedean but which satisfies Assumption ([3]). Finally, 
Assumption ([5|) says that the set of resources of potentially optimal solutions is bounded. Indeed, 
an optimal path must be feasible and of cost non-greater than c{xp)\ the feasible resources belong 
to p“^(0), and c~^ ((—cx), c(xp)]) is the set of resources whose cost is non-greater than the cost of 
path P. 

Theorem 1. Suppose that at least one of the following conditions is satisfied. 

(a) D is acyclic. 

(b) Assumptions ([31) and ([5]) are satisfied, Xa is positive for each arc a, and by 0 for each 
vertex v. 

(c) Assumptions 0 and dS]) are satisfied, © is commutative, and ©agf; positive for any 
cycle C in D. 

Then the generalized A* algorithm converges after a finite number of iterations, and at the end, if 
fi'o-ite, then it is the cost of an optimal solution of the Monoid Resource Constrained 
Shortest Path Problem. Otherwise, the problem admits no feasible solutions. 
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We note that in case (b), the hypothesis that 6^ ^ 0 is not restrictive, as Xq > 0 implies that 
xp ^ 0 for all paths P. Finally, Case (c) is notably satisfied when (7^,0,^) is an Archimedean 
lattice ordered group and cycle resources are positive. Indeed, Theorem 10.19 in [I^ ensures that 
any Archimedean lattice ordered group is commutative, and Assumption ([!]) is a consequence of 
the Archimedean property in ordered groups. 

Lemma 2. Let P he an o-d path satisfying p{xp) = 0. Then at a given step of the generalized A* 
algorithm, at least one of the following statements is satisfied: 

• there is a subpath P' of P in L, 

• c^d < c(xp). 

Note that P' can be equal to P. 

Remark 1. As c{xp' © by) < c{xp), where v is the destination of P, Lemma [2] implies that, if we 
stop the algorithm before its convergence, the minimum c{xpi © by) for P' ^ L provides a lower 
bound on the cost of an optimal path. 

Proof. We start with preliminary results. Paths are added to L only due to extension of paths in 
Step 3. A path Q can therefore be in L only if its subpaths have been considered, removed from 
L, and extended by the algorithm. Thus, at a given step of the generalized A* algorithm, for each 
path Q with origin o, exactly one of the following statements is satisfied; 

• Q has been considered by the generalized A* algorithm, 

• a subpath Q' of Q is in L, 

• a strict subpath Q' of Q has not been extended by the algorithm when considered. 

Besides, if a feasible o-d path Q has already been considered. Step 2 of the algorithm implies 

c^d < c(a^o)- 

We now prove Lemma[2l Suppose that none of the statements of Lemma[2]are satisfied. As P is 
a feasible o-d path, the two results above imply that a subpath P' of P has not been extended by 
the algorithm when considered. Let P' be this subpath, and v' be its destination. As decreases 
along the algorithm, the hypothesis implies that > c{xp) when P' is considered. As by/ is a 
lower bound on the resource of all v'-d paths, we have xpi (Bbyi ^ xp. By monotonicity of p and 
feasibility of P, we have p{xpi ®byi) = 0. By monotonicity of c, we have c(xp/ ©6^/) < c{xp) < 
when P' is considered. The two last inequalities imply that P' satisfies the lower bound test, which 
contradicts the fact that P' has not been extended, and we obtain the lemma. □ 

Lemma 3. Under Assumption ([5]), if an o-v path Q such that xq ® by ^ xm is considered by the 
algorithm, it does not satisfy the lower hound test (Low). 

Proof. Suppose that Assumption ([5]) is satisfied, and that Q is considered by the algorithm. If 
p{xQ ® by) = 1, path Q does not satisfy the lower bound test and we obtain the result. We now 
prove that, if p{xQ © by) = 0, we have < c{xq © by) when Q is considered by the algorithm, 
which then implies that Q does not satisfy the lower bound test, which gives the lemma. Suppose 
that it is not the case. We place ourselves at the step when Q is considered. As a consequence, Q 
minimizes c(xq © by) among the paths in L. Let P and xm be as in Assumption ([5]). By definition 
of P and Xm, the hypothesis XQ®by ^ xm implies c(xp) < c{xQ®by) < when Q is considered. 
Lemma [2] implies that there is a subpath P' of P in L when Q is considered. By monotonicity of c 
we have c{xpi ® byi) ^ c{xp) < c{xq ® by). This contradicts the fact that Q minimizes c{xq ®by) 
among the paths in L, and gives the lemma. □ 

Lemma 4. Suppose that (a), (b), or (c) is satisfied, then there is a finite number of paths in D 
that satisfy the lower-bound test. 
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Proof. In case (a), graph D is acyclic and there is a finite number of paths. We now suppose that 
we are in case (b) or (c): let xm be as in one Assumption Q. Lemma [3] ensures that only o-v 
paths P such that xp (Bb^ ^ Qm can satisfy the lower bound test. We show the lemma by proving 
that there is a finite number of such paths. 

As we are in case (b) or (c), any elementary cycle C 'm D satisfies xq > 0. Thus, given an 
elementary cycle C, an elementary path Q, and a vertex v in P, as the resource of C is positive, 
Assumption ([!]) implies that there exists an integer nc,Q,v such that {nc,Q,vXc) B xq ^ xm- 
As there is a finite number of elementary paths and a finite number of elementary cycles in D, we 
can define n to be an integer such that 

(6) {nxc) BxqBhy ^XM 

for any elementary cycle C, elementary path Q, and bound by. Let nc be the number of elementary 
cycles in D. 

The proof of case (b) relies on the following well-known result. 

Any path in a directed graph can be decomposed in a sequence of elementary paths and elementary 
cycles. 

Suppose that we are in case (b), let P be a path with at least 2nnc\V\ arcs and consider such 
a decomposition. As an elementary path or an elementary cycle contains at most \V\ arcs, this 
decomposition contains at least nnc cycles, and thus at least n copies of a given cycle Cq. As 
the resource of all arcs are positive by hypothesis of case (b), we have xp ^ nxc^. We therefore 
have xp B by ^ nxco © by, and by applying Equation ([6]) with the empty path as Q, we obtain 
xp B by ^ Xm- As a consequence, only o-v paths P with fewer than 2nnc\V\ arcs can satisfy 
Xp B by ^ Qm , and Lemma [3] ensures that there is a finite number of paths that satisfy the lower 
bound test in case (b). 

We now consider case (c). As the monoid is supposed to be commutative, the resource of a path 
does not depend on the order of the sequence of its arcs, but only on its multiset of arcs. The proof 
of case (c) relies on the following well-known result. 

The multiset of arcs of any path in a directed graph can be decomposed in the union of the sets 
of arcs of an elementary path and of several elementary cycles. 

Suppose that we are in case (c), let P be a path with at least nlEKnc© 1) arcs and consider such 
a decomposition where Q denotes the elementary path. As by hypothesis of case (c), the operator 
© is commutative, the resource of P is entirely defined by the resource of its arcs, independently 
of their order. As an elementary path or an elementary cycle contains at most |E| arcs, this 
decomposition contains at least nnc cycles, and thus at least n copies of a given cycle Cq. As, by 
hypothesis of case (c), all cycles are positive, we have xpBby ^ nxc^ BxqBby. Equation [6] ensures 
that only paths with less than nlEKnc + 1) arcs can satisfy xp B by ^ and Lemma [3] ensures 
that there is a finite number of paths that satisfy the lower bound test in case (c). □ 

Proof of Theorem [IJ As any path inserted in L is the extension of a previously considered path, a 
given path is considered at most once by the algorithm. Thus, Lemma 0] implies the convergence 
after a finite number of iterations as only paths satisfying the lower bound test can be extended by 
the algorithm. 

At the end of the algorithm, list L is empty and Lemma [2] ensures that c^^ is a lower bound on 
the cost of any o-d path satisfying p{xp) = 0. Besides, Step 2 of the algorithm ensures that if c^^ 
is different from +oo, then there is a path P such that c{xp) = and p{xp) = 0. This concludes 
the proof. □ 

4.2.2. Label correcting and label dominance algorithms. 

Theorem 5. Suppose that the resource of any cycle C in D satisfies xc ^ 0, then the label 
correcting algorithm converges after a finite number of iterations, and at the end, if c^£ is finite, 
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then is the cost of a non-dominated optimal solution of the Monoid Resource Constrained 
Shortest Path Problem. Otherwise, the problem admits no feasible solutions. 

Theorem 6. Suppose that the resource of any cycle C in D satisfies xc ^ 0, then the label 
dominance algorithm converges after a finite number of iterations, and at the end, if Co/ finite, 
then c^^ is the cost of a non-dominated optimal solution of the Monoid Resource Constrained 
Shortest Path Problem. Otherwise, the problem admits no feasible solutions. 

Remark that the label correcting and the label dominance algorithms converge under weaker 
conditions than those required for the convergence of the generalized A* algorithm in Theorem [TJ 

Lemma 7. Suppose that the resource of any C in D satisfies xc ^ 0, then if a path P containing a 
cycle is considered by the label dominance or the label correcting algorithms, then it does not satisfy 
the dominance test (dom). 

Proof. As paths in L are added by extension of paths previously in L, we only need to prove the 
result for paths ending by a cycle. Let P be such a path, let Q + C be its decomposition into 
a path and a cycle, and let v be the common destination vertex of P and Q. By hypothesis, we 
have xc ^0. As a consequence, xp = xq (B xc ^ xq. As P is processed, all its subpaths have 
been extended by the algorithm, and thus path Q has necessarily been extended. This implies that 
either Q or a path Q' such that xqi < xq < xp is in M„, and thus P is dominated by a path in 
and is therefore not extended. □ 


Proof of Theorem O As any path inserted in L is the extension of a previously considered path, a 
given path is considered at most once by the algorithm. Thus, as there is only a finite number of 
acyclic paths in a graph. Lemma [7] ensures that the algorithm converges after a finite number of 
iterations. 

Step (b) of the algorithm ensures that c^J^ is non-smaller than the cost of an optimal solution 
of the Monoid Resource Constrained Shortest Path Problem. We now prove that at the 
end of the algorithm, c^J^ is equal to the cost of an optimal solution. Indeed, suppose that it is not 
the case. Let P be an optimal solution. Let L be the set of all the paths that have been contained 
in L along the algorithm, and for each vertex v in P, let Pqv be the subpath of P starting v. Let 
V be the last vertex of P such that there is an o-v path Q in C with xq ^ xp^^. It exists because 
the empty path Poo is added to L at the beginning of the algorithm, and is therefore in C. Besides, 
it is not equal to d, as otherwise we would have c^J^ < c{xp). Among the o-v paths dominating 
Pov in C, let Q be the first one generated by the algorithm. By definition of Q and as any path 
that has been in My along the algorithm is in C, there is no path dominating Q in My when Q 
is processed. As decreases along the algorithm and by hypothesis, when Q is processed we 
have p{xq © by) < p{xp^^ © by) < p{xp) = 0 and c{xq © by) < c{xp^^ © by) < c{xp) < c^/. As 
a consequence, Q has been extended, and Q + {v, w) is in C, where w be the vertex after v in P. 
Besides, we have = xq ^ ©a^©,u)) = xp^^, which contradicts the definition of 

V. □ 


The proof of Theorem [6] is analogous and can be found in 



5. Bounding algorithms 

We now come to the computation of lower bounds by on the resource of any v-d path P. We 
have already mentioned in the introduction that such lower bounds by satisfy by ^ where 
by^^ = Apc-p Xp, and Pyd is the set of v-d paths. The bound 6 °'’* is therefore the best lower 
bound. We prove in Proposition 4.11 of [7]| the following complexity results on the computation 

oibT. 
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Proposition 8. Unless V = MV, there is no polynomial algorithm independent of TZ that enables 
to compute even when restrieted to a commutative monoid with positive resources. 

The proof is a reduction of the usual resource constrained shortest path problem. 

Computing 6°’’* is therefore difficult in the general case. However, Theorem [9] shows that when 
© distributes with respect to A, 6 °^* can be computed in polynomial time. The remaining of the 
section introduces polynomial procedures to compute lower bounds on 

5.1. Extended Ford-Bellman algorithm. Let be the sequence of tuples of resources de¬ 

fined recursively as follows. 

'^3 = 0 , 

by = oo and 6”+^ = K ^ /\ ® K) ^ 

, {v,u)g5+{v) 

As 7^ is a complete lattice, we can define hff’ = each vertex v. Let b"' denote the 

tuple (6”)„g\/. Recall that we have defined bf = to be the greatest solution of the following 

equation. 


bd = 0, 

fSi 

by = by A {x(y^u) © by) for all v € H\{d}. 

, {v,u)£ 5+ (v) 

The existence of a greatest solution of Equation ([8|) is a direct consequence of the Knaster-Tarski 
fixed point theorem applied in the complete product lattice TiX. This theorem states that the set of 
fixed points of a monotone mapping in a complete lattice is a non-empty complete lattice. Details 
on the Knaster-Tarski fixed point theorem can be found in [ 2 ^ . We underline that both bl and 6“ 
may be defined only in the completion of TZ. 


Theorem 9. Let i* be the length of the longest elementary v-d path. If xc ^ 0 for each cycle C 
in D, then for each vertex and v-d path P, we have 

(9) ^ C ^ bT ^ xp 

If (B distributes with respect to A, then three first inequalities are equalities. 


These bounds b^ are good candidates to be used as bounds by on the resource xp of all v-d paths P 
in the enumeration algorithms of Sectional Indeed, they can be computed in 0{\A\P) operations © 
and A by computing the I* first terms of sequence (b”)^ using its definition in Equation ([7|). Besides, 
the sequence (b"')^ can be interpreted as a generalization of the Ford-Bellman algorithm. Indeed, 
when (7^,©,^) = (M,+,<), or more generally when (7^,©,^) is a totally ordered group, the 
meet xi A X2 of two resources xi and X2 is the minimum of xi and X2. In that case, the sequence 
of Equation ([7]) corresponds to the successive steps of the Ford-Bellman shortest path algorithm, 
and for each integer k, the bound by is the value of a shortest o-v path with at most k arcs. 

The proof of Theorem [9] relies on two lemmas. The mapping F : IZX -A IZX defined as follows is 
useful in the proof. 


r = 0, 


by = by A © by) for all v G K\{(7}, 

(v,u)g5+ (v) 
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( 10 ) 


F{h) = b^ with < 





where TZ^ denotes the Cartesian product. Note that = F (b”) and that F is isotone by 

monotonicity of the operators 0 and A. 

Lemma 10. For each vertex v and integer n, we have bl ^ ^ b^. 

Proof. A straightforward induction on n based on the isotony of mapping F defined in Equation (IlOp 
gives bl ^ 6 ” for all n, which implies that ^ 6 ^. □ 

Lemma 11. The resource b^ is a lower bound on the resource xp of the v-d paths P of length at 
most k. When © distributes with respect to A, b^ is the meet of the resources of the v-d paths of 
length at most k. 

Proof. The result is proved by induction on k. The result for k = 0, i.e. 6 ° is equal to 0 if u = d and 
oo otherwise, follows from the fact that the only path of length 0 is the trivial path. Let A; > 0 be 
an integer and suppose the result is true up to A: — 1, let u be a vertex, and let P be a v-d path with 
£{P) < k. If i{P) = 0 then v = d and xp ^ b^ = 0. Otherwise let {v, u) be the first arc of P and 
Q be the subpath of P obtained by removing {v,u) from P. Then i(Q) < k — 1, thus b^~^ ^ xq 
which implies 0 b^~^ ^ © xq and finally b^ ^ xp, which gives that by is a lower bound 

on the resource xp of the v-d paths P of length at most k. 

When 0 distributes with respect to A, we have xi 0 (x 2 A X 3 ) = (xi 0 X 2 ) A (xi 0 X 3 ). Suppose 
that 5^“^ is the meet of the resource of all the v-d paths of length at most k for each vertex u. 
Then 0 6 ^“^ is the meet of the resources xp of all the v-d paths P starting by {v,u) such 

that i{P) < k. Thus by~^ A A ( X(v,u) ® is the meet of all the v-d paths of length at 

{v,u)gS+ (v) 

most k. □ 

Proof of Theorem [PI As the resource of any cycle C in D satisfies xc > 0, for each o-d path P, 
there is an elementary o-d path P' such that xp/ ^ xp. Hence, by^^ is the meet of the resources 
of all the elementary o-d paths. As the length of any elementary v-d path is non greater than i*, 
Lemma [TT] implies that by ^ xp for all elementary v-d paths P, and thus by < bfF^. Lemma [TOl 
then gives Equation Q. 

Suppose now that © distributes with respect to A. We already mentioned that xc ^ 0 for all 
cycles C implies that 5°^* is the meet of all the elementary o-d paths. As the length of an elementary 
path is non greater than F , Lemma [11] implies that by = 6 °’’*. This implies that F (b^ ) = b^ and 
by* is a solution of Equation Q. Thus, by* = bl, which gives the result. □ 

Remark 2. If there are cycles with negative resources in D, then Theorem [Pj remains true provided 
that, first, P is an elementary v-d path, and second, 6 °^* is defined as the meet of the resources of 
all the elementary v-d paths. Besides, Lemma [TTl implies that bl = b^ = —00. 

Remark 3. The sequence (b"')^ is the sequence used in the constructive proof by Cousot k. Cousot 
[ 2 ^ of the Knaster-Tarski fixed point theorem for mapping the F defined in Equation (jlOl) . Given a 
topology and some weak assumptions on TZ, it can be proved that by converges to 6 ^ and 6 “ = bl. 
The inequality A(,;,«)e 5 + 0 )^ is easy to prove: indeed, as X(^^„) 06 ;f ^ X(y^y)®b^ for 
each arc {v,u) in 5+(u) and for all n in Z+, we have A(,;,n)G5+0)(^0,0 ® ^2°) ^ A(,;,n)G<5+(t;)(3^0,0 ® 
by) = by~^^ for all n G Z+, which gives the result. The inequality A('u u)G5+(i^) {X(v,u) ® ^2°) ^ 
requires a transfinite induction. 

5.2. Generalized Dijkstra algorithm for faster bound computations. In all our numerical 
experiments, we have observed that practically, hi = bff^ = b^*. Therefore, the bounds we obtain if 
we compute bl are as good as those we obtain if we compute b^*. When 0 distributes with respect 
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to A, computing bl amounts to solving the algebraic path problem. There are algorithms for the 
algebraic path problem that are practically much more efficient than the generalized Ford-Bellman 
algorithm of the previous section. We now adapt one of these algorithms, which generalizes Dijkstra 
algorithm, to our lattice ordered monoid setting. 

A resource by and an integer hy are attached to each vertex v and updated during the algorithm. 
Initially, by = \J TZ, which may be dehned only in the completion of TZ, and hy = -|-oo for each vertex 
V ^ d, and bd = 0. During the algorithm, a queue L of vertices “to be extended” is maintained. 
Initially, the queue L contains only d. The algorithm ends when L is empty. While L is not empty 
and the minimum hy over all vertices v is non greater than £*, where is the maximum length of 
an elementary path ending in d, the following operations are repeated: 

• Extract from L a vertex v with minimum hy. 

• For each arc {u,v) in d~{v), extend v along {u,v): if by ^ Xf^y^y^ © by, then 

— Update hy to min(h„, 1 + hy). 

— Update by to by A © by). 

— Add u to L (if it is not already present). 

• Set hy = + 00 . 


Proposition 12. This algorithm terminates after at most i*\V\ iterations, where i* is the maximum 
length of an elementary path ending in d. The value by of by at the end of the algorithm is equal to 
by for each v € V. If L is empty at the end of the algorithm, then by = bl for all vertices v. 

When © distributes with respect to A, at the end of the algorithm, we have L = 0 and by = bl 
for all vertices v. 


The proof of Proposition [12] is technical but not difficult and relies on Theorem [9| The interested 
reader can hnd it in Proposition 4.15 in TlJ. If the complexity bounds we obtain are identical to 
those of the algorithm of the previous section, this algorithm is practically faster in practice, and 
should be preferred. We use it in our numerical experiments. 

In the first step, we can extract a vertex v that minimizes a key function <f{by) instead of one 
that minimizes hy. Using the key 4){x) = x, our algorithm corresponds to Dijkstra algorithm when 
(7^,©, = (M+,+,<). When an alternative 4>{by) is used instead of hy, the algorithm ends only 

when L is empty, and we loose the convergence of Proposition [121 However, in practice, the list L 
is always empty after a number of iterations that is not much larger than |I/|. In our numerical 
experiments, we use the ratio 

number of vertices extended before convergence 


( 11 ) 


7 = 


11^1 


to evaluate how fast the algorithm converges. As each vertex v such that there exists a v-d path 
is extended at least once, if there is a v-d path P for each vertex v in D, the ratio 7 is necessarily 
non smaller than 1. With a carefully chosen cf, convergence is fast: the worst 7 encountered in 
the numerical experiments is 2.6. Using hy, we have obtain ration 7 up to 20 times larger on the 
instance. 

When © distributes with respect to A, we have a convergence result for arbitrary cj). Indeed, in 
that case, the only difference between our algorithm and the one proposed by Mohri for the 

algebraic path problem is that the vertex picked-up in L at each iteration is arbitrarily chosen. 
Mohri 65(] shows that, after a finite but possibly exponential number of iterations, L is empty and 
the algorithm terminates. 


Remark 4. When digraph D is acylic, the bounds bl can easily be obtained with an even faster 
algorithm. Indeed, using a topological ordering, they can be computed iteratively directly from the 
dynamic programming equation ([ 8 ]). 
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Name 

Generator 

Brief description 

road 

extraction 

Road networks with a given number of vertices. 

square 

grid 

Square grid of size m x m 

long 

grid 

Long grid of size 16m x m 

wide 

grid 

Wide grid of size m x 16m 

acyc 

acyclic 

Acyclic graph with n vertices vi,... ,Vn and 5n arcs {vi,Vj) with i < j 

rand 

random 

Hamiltonian cycle with n vertices and 5n — n chords. 


Table 2. Summary of the families of graphs used 


6. Numerical experiments on usual resource constrained shortest path problem 


In this section, we test numerically our enumeration algorithms on the usual resource constrained 
shortest path problem with k = 1 and A: = 10 constraints, 

„o 


( 12 ) 


mm 

P&Vod 

s.t. 


a&P 

aeP 


a<W\ 


where ic® G M for each arc a and i G {0, ... , fe}, thresholds IT® G M for i G {1,..., fe}, and Vod is the 
set of o-d paths. We model it as a Monoid Resource Constrained Shortest Path Problem 
with resources x G 

c{x) = uP and p(x) = max(l(^yi _|_oo)(rc®)), 

where x = {w^,... and l(rui,+oo) is the indicator function of the interval (lT®,+oo). As 

we focus on instances with positive resources, Theorems [11(b), [H and [6] ensure respectively the 
convergence of the generalized A*, label correcting, and label dominance algorithms. 


6.1. Instances. We use four families of graphs: road networks, acyclic graphs, grids, and random 
graphs. The three last families of graphs are used by Cherkassky et al. [2l| in their experimental 
study of algorithms for the Shortest Path Problem. We have used adapted versions of their 
generators spgrid, sprand, and spacyc to produce instances of these families. The adaptation 
consists in the insertion of a destination vertex. Among others, these four family of graphs have 
been used by Dumitrescu & Boland 28] to test the different Resource Constrained Shortest 


Path Problem algorithms available in the literature. We now describe them. 



Figure 1. From left to right, a grid graph of width 3 and depth 2, a random graph 
with 5 vertices and 9 arcs, and an acyclic graph with 4 vertices and 7 arcs. 


The road network graphs have been extracted from the Rome and the San Francisco Bay Area 
instances of the Dimacs challenge [l|, and the origin and the destination vertices have been chosen 
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far way from each other. Details on how these instances have been extracted are available in 0. 
A grid graph of length ^ and width m is composed of ^ layers of m vertices. Each layer z is a 
Hamiltonian cycle Vi^i,... ,Vi^rn with arcs in both direction. Each vertex Vij of layer i E [£ — 1] is 
connected to the corresponding vertex Wj+ij- in the next layer. An origin vertex o and a destination 
vertex d are added. There is an arc between the origin o and each vertex of the first layer, and 
an arc between each vertex of the last layer and the destination. A random graph with n vertices 
and m > n arcs is composed of n vertices on a Hamiltonian cycle and randomly generated chords 
on that cycle. Einally an acyclic graph with n vertices and m > n arcs contains a path vi,... ,Vn, 
and randomly generated arcs {vi,Vj) with i < j. The origin and the destination are respectively 
vi and Vn- Eigure [D illustrates a grid, a random and an acyclic graph. We consider random and 
acyclic graphs with re vertices and 5re arcs. We have obtained similar results are obtained when 
using digraphs with hn arcs with h between 2 and 50 0. Table [2] provides a summary of the main 
characteristics of these families of graph. 

The weight of an arc a of a road network instance is its length in kilometers. All the other 
weights of each type of graphs are randomly chosen using an uniform distribution on [1,100]. 
We use the same technique as [1^ to ensure the existence of an optimal path: we first search an 
o-d path Pc of minimum cost, then find an o-d path minimizing EE rc*, and finally set 


aePu, i£k 

PE* = (1 — ^)wp^ + Amax(ri;p, where A E [0,1] enables to choose the constraint strength. As 

the relative performances of the algorithms do not depend much of A, we always use A = 0.5 in this 


paper. A study of the influence of the constraint strength A is available in 71 j. 


6.2. Candidate paths, weaker bounds, and algorithms tested. We have tested the three 
enumeration algorithms introduced in Section 01 When bounds are needed, they are computed 
in a preprocessing using the generalized Dijkstra algorithm of Section 15.21 with x '^i=o S'S 
key function (j) of Equation (HID , where x = {w^,... ,w^). On acyclic instances, we use instead the 
algorithm of Remark 01 We have also tested two variants of the enumeration algorithms, that we 
now introduce. 

Candidate paths. A standard technique to improve the performance of resource constrained shortest 
path algorithms [1^ relies on the use of v-d paths that are likely to be subpaths of optimal v-d 
paths. We find such paths during the preprocessing: we use Dijkstra algorithm to find the v-d 
path P that minimizes YlaepYli=o'‘^a- When an o-v path P satisfies the test of an enumeration 
algorithm, before extending it, we test if P-\-Qy is a feasible solution of cost smaller than c^J^, and 
update if it is. This procedure may enable the algorithm to find faster feasible o-d paths of good 
quality. The upper bound c^^ is therefore likely to decrease faster, which enables to strengthen 
the lower bound test and thus reduce the total number of paths enumerated by the algorithm. 
Weaker bounds. To identify the respective contributions of the lower bound test (Low) and of the 
keys c{xp © by) to the performance of the generalized A* and the label correcting algorithms, we 
also provide numerical results for “downgraded” versions of the generalized A* and label correcting 
algorithms where c{xp) is used instead of c{xp © by) as key. 


6.3. Experimental setting. The numerical experiments are performed on a Macbook Pro of 2012 
with four 2.5 Ghz processors and 4 Gb of ram. The algorithms are not parallelized. The limiting 
parameter for the algorithms is the memory available. Therefore, we stop the algorithms if the list 
L of candidate paths contains more than le+05 elements. We also stop the label correcting and 
the label dominance algorithms if the number of paths in the union of the sets of non dominated 
paths My is larger than le+05. As we mention in Remark [H the minimum c{xp + 5„) on the paths 
P in L when the algorithm is stopped provides a lower bound on the cost of an optimal solution, 
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Figure 2. Usual RCSP with k = 1 constraint 

and provides an upper bound. These two bounds are used to compute a gap on instances that 
cannot be solved to optimality. 

6.4. Numerical results. We now come to numerical results on Problem (1121) . Figure [2] plots the 
performance of our algorithms for each family of instances. As there is only one degree of freedom 
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Figure 3. Usual RCSP with A: = 10 constraints 

in the definition of instances of each family of graphs, we can identify an instance of a given family 
by its number of vertices. For each of our enumeration algorithms in Table [H there is a curve that 
gives the total CPU time as a function of the number of vertices. This total CPU time includes the 
computation of bounds in the preprocessing. Curves A*, cor., and dom. correspond respectively 
to the generalized A*, the label correcting and the label dominance algorithm. We only add points 
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corresponding to instance solved to optimality. Therefore, the longer and the lower a curve, the 
better the performance of the corresponding algorithm. Figure [3] provides the same results for the 
problem with /c = 10 constraints. 

Tables [3] and 0] provide detailed results on some difficult instances with respectively k = 1 and 
A; = 10 constraints. The first columns provide the instance considered, the number of vertices, and 
the number of arcs in the instance. The next column provides the enumeration algorithm tested. 
Again, A* corresponds to the generalized A* algorithm, cor. to the label correcting algorithm, and 
dom. to the label dominance algorithm. The suffix CP indicates that the variant of the algorithm 
with candidate paths is considered, and the suffix K that c{xp) is used instead of c{xp © b^). 
The ratio 7 of the next column is the one of Equation (llip . and indicates the performance of 
the generalized Dijkstra algorithm. The lower 7 , the better is the performance of this algorithm. 
The next column provides the percentage of the total CPU time spent in the preprocessing. For 
the standard version of the label dominance algorithm, no preprocessing is needed, while for the 
generalized A* and the label correcting algorithm, this preprocessing time indicates the time needed 
to compute lower bounds. When candidate paths are computed, the percentage after the symbol 
+ indicates the percentage of the total CPU time spent computing them. The two next columns 
provide the number of paths extended and the number of paths cut. The next column indicates 
the percentage of paths cut by the dominance test, the remaining being cut by the lower bound 
test. The other algorithm are not concerned as they use a single test to cut paths. The column i 
provides the number of arcs in the solution returned. The next column provides the gap between 
the lower and the upper bound when the algorithm is stopped before convergence, and the last 
column provides the total CPU time. 

Difficulty of the instances. We first, remark that the difficulty of the instances is mainly linked 
to the number of arcs I in an optimal solution. The smaller this number of arcs, the easier the 
instances. The acyclic and the random graph instances are therefore the easiest to solve, and any 
version of our algorithms can solve them well. Then comes the road network instances and the 
wide grids. The most difficult instances are the square and the long grids. 

Relative performance of the algorithms. The label dominance algorithm has the best performances 
on the easy instances, i.e. the acyclic and the random instances. If we look at Tables [3] and 01 we 
can see that on these instances, most of the computation time of the generalized A* and of the 
label correcting algorithms is spent in the preprocessing, gathering information that is not needed 
as the problem is easy to solve. On the other instances, the label correcting algorithm has the best 
performance. Using lower bounds in addition to the dominance test is always interesting on difficult 
instances. The relative performance of the generalized A* algorithm and of the label correcting 
algorithm depends on the family of instances considered. 

Influence of dimension and relative performance of the algorithms. Instance with ten constraints 
are more difficult to solve than instances with one constraint. We also underline the fact that 
the relative performance of the algorithms on instances with ten constraints is different from the 
performance in the case of instances with one constraint. Indeed, the label dominance algorithm 
exhibits poor performances in that setting, while the generalized A* performs almost as well as the 
label correcting algorithm. We can also see in the tables that the percentage of paths cut by the 
dominance test in the label correcting algorithm decreases with the dimension. Section [ 8 ] explains 
why the performance of the dominance test decreases with the dimension, and provides techniques 
to increase the performance of our algorithms on problems in large dimension. 

Influence of keys. Figure 0] provides the performances of the generalized A* and of the label correct¬ 
ing algorithms with different keys to solve Problem (I12h on wide grids with k = 1 constraint. Plain 
lines correspond to the key c{xp © by) and dashed lines to the key c{xp). On instances with A: = 1 
constraint, There is no-dashed line corresponding to the generalized A* because only one instance 
was solved by the algorithm with key c{xp). When bounds by have been computed for the lower 
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Instance 

Tl 

I>1| 

Alg. 

7 

Preproc. 

Ext. 

Cut. 

Dom. 


Gap 

CPU (s) 

road20 

20000 

55180 

A* 

1.6 

15% 

54131 

14121 

- 

- 

CX3 

3.08e-01 




A* CP 

1.6 

9%+10% 

55762 

17579 

- 

252 

2.5% 

4.91e-01 




A* K 

1.6 

16% 

71402 

4 

- 

- 

CX3 

3.21e-01 




cor. 

1.6 

64% 

7899 

8306 

44% 

243 

opt 

7.32e-02 




cor. CP 

1.6 

36%+37% 

7852 

8228 

44% 

243 

opt 

1.30e-01 




cor. K 

1.6 

1% 

1128194 

793042 

92% 

243 

opt 

7.17e+00 




dom. 

- 

- 

1505043 

995349 

- 

- 

oo 

1.06e+01 




dom. CP 

- 

-+0% 

1505043 

995349 

- 

243 

21.0% 

1.20e+01 

roadSO 

50000 

138112 

A* 

2.7 

43% 

44613 

3710 

- 

- 

OO 

4.42e-01 




A* CP 

2.7 

25%+21% 

44613 

3710 

- 

494 

13.6% 

7.21e-01 




A* K 

2.7 

42% 

71420 

0 

- 

- 

oo 

4.71e-01 




cor. 

2.7 

17% 

153191 

80428 

96% 

- 

oo 

1.12e+00 




cor. CP 

2.7 

12%+10% 

153221 

80488 

96% 

478 

5.5% 

1.60e+00 




cor. K 

2.7 

1% 

1570406 

1047263 

99% 

- 

oo 

1.37e+01 




dom. 

- 

- 

1557409 

1029848 

- 

- 

oo 

1.21e+01 




dom. CP 

- 

-+1% 

1557409 

1029848 

- 

462 

431.2% 

1.44e+01 

squarelOO 

10002 

30100 

A* 

1.6 

9% 

58533 

17162 

- 

- 

oo 

2.69e-01 




A* CP 

1.6 

7%+6% 

58533 

17162 

- 

131 

30.4% 

4.36e-01 




A* K 

1.6 

10% 

50298 

690 

- 

- 

oo 

2.62e-01 




cor. 

1.6 

3% 

168036 

155429 

58% 

118 

opt 

7.84e-01 




cor. CP 

1.6 

2%+2% 

168016 

155396 

58% 

118 

opt 

l.Ole+00 




cor. K 

1.6 

0% 

1488625 

981538 

99% 

- 

oo 

1.17e+01 




dom. 

- 

- 

1493529 

973040 

- 

- 

oo 

1.05e+01 




dom. CP 

- 

-+0% 

1493529 

973040 

- 

131 

25.1% 

1.21e+01 

long20 

5122 

15376 

A* 

1.6 

5% 

51961 

3933 

- 

- 

oo 

2.66e-01 




A* CP 

1.6 

3%+4% 

51961 

3933 

- 

438 

58.6% 

4.17e-01 




A* K 

1.6 

6% 

49996 

3 

- 

- 

oo 

2.36e-01 




cor. 

1.6 

1% 

186590 

93798 

96% 

- 

oo 

1.12e+00 




cor. CP 

1.6 

!%+!% 

186590 

93798 

96% 

419 

33.9% 

1.45e+00 




cor. K 

1.6 

0% 

1558600 

1025370 

100% 

- 

oo 

2.56e+01 




dom. 

- 

- 

1558884 

1024684 

- 

- 

oo 

2.36e+01 




dom. CP 

- 

-+0% 

1558884 

1024684 

- 

437 

202.3% 

2.62e+01 

wide 100 

25602 

78400 

A* 

1.5 

97% 

107 

1809 

- 

21 

opt 

7.23e-02 




A* CP 

1.5 

51%+47% 

104 

1806 

- 

21 

opt 

1.42e-01 




A* K 

1.5 

19% 

67108 

35812 

- 

- 

CX3 

4.22e-01 




cor. 

1.5 

97% 

98 

1785 

0% 

21 

opt 

7.36e-02 




cor. CP 

1.5 

50%+48% 

95 

1782 

0% 

21 

opt 

1.40e-01 




cor. K 

1.5 

17% 

105678 

99041 

58% 

21 

opt 

4.51e-01 




dom. 

- 

- 

148903 

83968 

- 

21 

opt 

4.62e-01 




dom. CP 

- 

- +10% 

148564 

83772 

- 

21 

opt 

6.79e-01 

acyc10000 

10000 

50000 

A* 

1 

97% 

12 

63 

- 

10 

opt 

9.20e-03 




A* CP 

1 

32%+66% 

7 

51 

- 

10 

opt 

2.59e-02 




A* K 

1 

96% 

22 

127 

- 

10 

opt 

9.14e-03 




cor. 

1 

95% 

12 

63 

0% 

10 

opt 

8.07e-03 




cor. CP 

1 

29%+70% 

7 

51 

0% 

10 

opt 

2.61e-02 




cor. K 

1 

95% 

22 

127 

0% 

10 

opt 

l.Ole-02 




dom. 

- 

- 

5918 

1413 

- 

10 

opt 

1.99e-02 




dom. CP 

- 

- +50% 

5909 

1407 


10 

opt 

3.44e-02 

randlOOOO 

10000 

50000 

A* 

2.6 

99% 

41 

161 

- 

10 

opt 

7.48e-02 




A* CP 

2.6 

68%+32% 

37 

144 

- 

10 

opt 

l.lOe-01 




A* K 

2.6 

89% 

2078 

9393 

- 

10 

opt 

1.05e-01 




cor. 

2.6 

99% 

41 

161 

0% 

10 

opt 

8.02e-02 




cor. CP 

2.6 

65%+35% 

37 

144 

0% 

10 

opt 

1.13e-01 




cor. K 

2.6 

89% 

1957 

7889 

2% 

10 

opt 

1.17e-01 




dom. 

- 

- 

67626 

41871 

- 

10 

opt 

2.26e-01 




dom. CP 

- 

- +12% 

67378 

41653 

- 

10 

opt 

3.31e-01 


Table 3. Standard resource constrained shortest path with k = 1 resource constraint 
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Instance 

|h| |>1| Alg. 

7 

Preproc. 

Ext. 

Cut. 

Dom. 


Gap 

CPU (s) 

road20 

20000 

55180 

A* 

2.1 

7% 

253214 

323551 

- 

- 

00 

9.75e-01 




A* CP 

2.1 

6%+4% 

253214 

323551 

- 

221 

55.3% 

1.23e+00 




A* K 

2.1 

5% 

340302 

556262 

- 

- 

oo 

1.50e+00 




cor. 

2.1 

24% 

45066 

66374 

21% 

221 

opt 

3.02e-01 




cor. CP 

2.1 

18%+13% 

45034 

66317 

21% 

221 

opt 

3.82e-01 




cor. K 

2.1 

25% 

45177 

66416 

21% 

221 

opt 

2.96e-01 




dom. 

- 

- 

1103713 

603707 

- 

- 

oo 

3.48e+01 




dom. CP 

- 

-+0% 

1103713 

603707 

- 

221 

373.3% 

3.91e+01 

roadSO 

50000 

138112 

A* 

2.5 

47% 

56159 

9481 

- 

- 

OO 

4.59e-01 




A* CP 

2.5 

30%+19% 

56159 

9481 

- 

400 

18.1% 

7.12e-01 




A* K 

2.5 

43% 

71421 

1 

- 

- 

OO 

5.02e-01 




cor. 

2.5 

12% 

64093 

17783 

53% 

- 

00 

1.80e+00 




cor. CP 

2.5 

10%+7% 

64093 

17783 

53% 

400 

18.0% 

2.10e+00 




cor. K 

2.5 

1% 

466563 

303206 

99% 

- 

OO 

2.91e+01 




dom. 

- 

- 

477467 

307503 

- 

- 

00 

2.67e+01 




dom. CP 

- 

-+0% 

477467 

307503 

- 

400 

1321.4% 

2.76e+01 

squareSO 

2502 

7550 

A* 

2.2 

3% 

81247 

62539 

- 

- 

OO 

3.46e-01 




A* CP 

2.2 

2%+2% 

81247 

62539 

- 

52 

57.5% 

4.73e-01 




A* K 

2.2 

3% 

56775 

13594 

- 

- 

OO 

2.85e-01 




cor. 

2.2 

0% 

141815 

103501 

39% 

- 

oo 

2.41e+00 




cor. CP 

2.2 

0%+0% 

141815 

103501 

39% 

52 

49.3% 

2.64e+00 




cor. K 

2.2 

1% 

179777 

93497 

89% 

- 

OO 

2.00e+00 




dom. 

- 

- 

168274 

78864 

- 

- 

00 

1.64e+00 




dom. CP 

- 

-+0% 

168274 

78864 

- 

52 

376.1% 

1.84e+00 

long5 

1282 

3856 

A* 

2.2 

2% 

64642 

29295 

- 

- 

OO 

2.79e-01 




A* CP 

2.2 

!%+!% 

64642 

29295 

- 

81 

67.9% 

4.02e-01 




A* K 

2.2 

2% 

52538 

5087 

- 

- 

OO 

2.39e-01 




cor. 

2.2 

0% 

101197 

52388 

48% 

- 

00 

1.70e+00 




cor. CP 

2.2 

0%+0% 

101197 

52388 

48% 

81 

62.9% 

1.90e+00 




cor. K 

2.2 

0% 

196476 

98269 

99% 

- 

OO 

3.06e+00 




dom. 

- 

- 

195012 

96678 

- 

- 

oo 

2.81e+00 




dom. CP 

- 

-+0% 

195012 

96678 

- 

81 

599.7% 

3.03e+00 

wide 100 

25602 

78400 

A* 

2.1 

85% 

6702 

14999 

- 

17 

opt 

1.22e-01 




A* CP 

2.1 

59%+27% 

6698 

14994 

- 

17 

opt 

1.81e-01 




A* K 

2.1 

83% 

6711 

15017 

- 

17 

opt 

1.38e-01 




cor. 

2.1 

82% 

6413 

13731 

3% 

17 

opt 

1.25e-01 




cor. CP 

2.1 

60%+27% 

6409 

13726 

3% 

17 

opt 

1.74e-01 




cor. K 

2.1 

83% 

6421 

13745 

3% 

17 

opt 

1.40e-01 




dom. 

- 

- 

108128 

38179 

- 

- 

00 

4.92e-01 




dom. CP 

- 

- +7% 

108128 

38179 

- 

17 

314.6% 

6.69e-01 

acyc10000 

10000 

50000 

A* 

1 

91% 

6 

24 

- 

5 

opt 

2.79e-03 




A* CP 

1 

47%+51% 

2 

12 

- 

5 

opt 

4.97e-03 




A* K 

1 

89% 

6 

24 

- 

5 

opt 

2.46e-03 




cor. 

1 

83% 

6 

24 

0% 

5 

opt 

2.52e-03 




cor. CP 

1 

42%+56% 

2 

12 

0% 

5 

opt 

4.93e-03 




cor. K 

1 

84% 

6 

24 

0% 

5 

opt 

2.63e-03 




dom. 

- 

- 

211 

0 

- 

5 

opt 

1.08e-03 




dom. CP 

- 

- +77% 

210 

0 

- 

5 

opt 

3.95e-03 

randlOOOO 

10000 

50000 

A* 

6.3 

100% 

13 

56 

- 

7 

opt 

2.41e-01 




A* CP 

6.3 

88%+12% 

9 

37 

- 

7 

opt 

2.58e-01 




A* K 

6.3 

100% 

14 

57 

- 

7 

opt 

2.47e-01 




cor. 

6.3 

100% 

13 

56 

0% 

7 

opt 

2.32e-01 




cor. CP 

6.3 

88%+12% 

9 

37 

0% 

7 

opt 

2.67e-01 




cor. K 

6.3 

100% 

14 

57 

0% 

7 

opt 

2.50e-01 




dom. 

- 

- 

7183 

160 

- 

7 

opt 

4.18e-02 




dom. CP 

- 

- +40% 

7177 

159 

- 

7 

opt 

8.55e-02 


Table 4. Standard resource constrained shortest path with A: = 10 resource constraint 
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k = 1 


k = 10 




Figure 4. Influence of keys on usual RCSP with k = 1 and k = 10 constraint 


k = 1 



Vertices 


k = 10 



Vertices 


Figure 5. Influence of candidate paths on usual RCSP with k = 1 and k = 10 constraint 


bound test, is is always more interesting to use the key c{xp (Bby) than the key c{xp). In practice, 
the key has an influence only on weakly constrained problems with k = 1, where the keys identify 
which partial solutions are the most promising. On more constrained problems with k = 10, we 
are not able to guess which partial solution will lead to a feasible solution, and the importance of 
keys decreases. 

Influence of candidate paths. Figure [5] shows the influence of candidate paths on the performances 
of the algorithms on the wide grid instances with k = 1 and k = 10 constraints. Plain lines corre¬ 
spond to algorithms without candidate paths, and dashed lines to algorithms with candidate paths. 
Candidate paths are not interesting on instances that can be solved to optimality: the decrease in 
is not large enough to enable to reduce significantly the number of paths enumerated. There¬ 
fore, the use of candidate paths only slow the algorithm by requiring a preprocessing and slowing 
each step of the enumeration. On the contrary, we can see in Tables [3] and 0] that candidate paths 
become interesting on difficult instances: they enable to find feasible o-d paths of small cost along 
the algorithm, and thus to obtain a smaller gap. 
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7. Stochastic path problems: models and numerical experiments 


We now come to the stochastic path problems mentioned in the introduction. We suppose to 
have a random variable for each arc a, and denote = Y2aeP^a. for each path P. Given an 
origin o and a destination v, a stochastic path problem typically seeks an o-d path P minimizing a 
probability functional ^ 


min n 
P&Vod 



Three types of probability functionals ^ are of specific interest. First, given r € M, the functional 
P(- > r) enables to model the probability of arriving on time at an event starting at r. Second, util¬ 
ity theory considers the expectation !£(/(•)) of a non-decreasing cost function /. Third, stochastic 
optimization often deals with risk measures [^, i.e. probability functionals /r that are normalized, 
/r(0) = 0, monotone with respect to the almost sure order, i.e. /r(^) < if ^ ^ almost surely, 

and invariant by translation -|- c) = /u(^) + c for all c € M. Alternative definitions of risk 
measures exist in the literature, but all assume the monotonicity with respect to the almost sure 
order. Stochastic constraints are typically of the form 


IJ-'ifp) < a, 


where p,' is a probability functional. The most common stochastic constraints are probability 
constraints of the type 

> t) < a. 

We now provide techniques to model stochastic path problems within the Monoid Resource 
Constrained Shortest Path Problem framework. To that purpose, with introduce several 
lattice ordered monoids of random variables. On a given lattice ordered monoid (77,0, ^), we can 
model any stochastic path problem such that the functions 


c(0 = KO and p(0 = l(a,oo](/^'(0) 

are isotone with respect to On the lattice ordered monoids we consider, this property is satisfied 
by any probability functional /i or p.' that is monotone with respect to the almost sure order. This 
is notably the case of all the probability functionals /r and p.' of interest aforementioned. 


7.1. General case. Given arbitrary random variables the vector space of the random variables 
endowed with the addition and the almost sure order is a lattice ordered monoid. Indeed, the 
addition is compatible with the almost sure order, as given three random variables and ff such 
that ^ ^ a.s., we have f,+f! < a-S-- Besides, the almost sure order induces a lattice structure 

and the meet of two random variables is their essential-infimum, which is unique up to a.s. equality. 

Practically, to be able to make the computations, we sample from the initial random variables 
a finite number N of scenarios ui,... ,ujn- The sampled distribution can therefore be encoded 
as elements of M^. The a.s. order between the sampled distributions becomes the component by 
component order on and the essential infimum becomes the minimum: 

The lattice ordered monoid we use is therefore (M^,0 ,<). We provide in 0] upper bounds on 
the error committed due to sampling that are exponential in the number of samples. 


7.2. Independent random variables. When the random variables are independent, we can 
work on their distributions. Indeed, the distribution of the sum of two random variables is their 
convolution product *. In that case, we can use the usual stochastie order <st which is such that 

f, <st C if < t) > < t) for all t € M. 
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The usual stochastic order is compatible with the convolution product. Practically, we work on the 
set M of distributions of random variables with finite support on Z. We denote the cumulative 
distribution of The usual stochastic order induces a lattice structure on M, and the meet ^ Ast C 
of two random variables ^ and ^ is defined through its cumulative distribution: 

We can therefore work with resources in the lattice ordered monoid (M,*,<gt). A probability 
functional /r is version independent if /i(^) depends only on the distribution of As we work on 
the random variables distributions, we can use only version-independent probability functionals. 

All the probability functionals of interest mentioned at the beginning of the section are version 
independent. And as they are also monotone with respect to the almost sure order, the following 
proposition ensures that we can deal with them using the Monoid Resource Constrained 
Shortest Path Problem framework with resource in (M, *, <st). 

Proposition 13. A version independent probability functional that is monotone with respect to the 
almost sure order is monotone with respect to the usual stochastic order <st. 

The proof of this proposition is straightforward and can be found in 0. The converse statement 
holds even for probability functionals that are not version independent as the usual stochastic order 
is coarser than the almost sure order, i.e. 

f < i a.s. implies ^ <st i- 


As <st is coarser than the almost sure order, the lower bounds we obtain using our algorithms 
with resources in (M, *,<st) are tighter than the one we obtain using the sampling approach of 
the previous section with resources in (R^,+,<st)- Therefore, when the f,a are independent, it is 
always more interesting from an algorithmic point of view to use resources in (M, *,<gt) than to 
use the sampling approach. 

We can also use parametric families of distributions that are stable by convolution product 


instead of discrete distributions. We notably introduce in [7]| lattice ordered monoid structures 


to model the families of distributions considered in the literature: normal distributions, gamma 
distributions, and Cauchy distributions. 


Remark 5. (M, *, <gt) is an example of lattice ordered monoid that is not an indempotent semiring, 
as * does not distribute with respect to Ast. 


7.3. Numerical results. We now benchmark our algorithms on two stochastic path problems. 
We consider here independent random variables We provide in 7]| numerical results on the 
same problems and graph instances, but with sampled distributions of non-independent random 
variables fa- 


The Condition Value-at-Risk [7^ of level /3 G [0,1) is 


CVaR^(0 = 


1 


1-/3 


VaRa(^)(ia, 


where VaRa(^) = inf <t)> a}. Intuitively, the Conditional Value at Risk of level /3 can be 

interpreted as the expectation in the j3 worst case. Parameter /3 enables to choose a level of risk 
awareness. As the conditional value at risk is one of the most popular risk measures in stochastic 
optimization, the first problem on which we test our algorithms is 


(13) 


min 

P^'Pod 



For instance, the optimal solution with /3 = 0.05 of this problem is the best itinerary for a commuter 
going to work: it gives an itinerary that is still good the most congested day of the month. 
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The second problem we consider is a shortest path problem with deterministic cost and proba¬ 
bility constraints: 


(14) 


min 

P^Vod 


aGP 


S.t. 




a£P 


< a. 


where r € M and Wa are weights in M. This problem can be interpreted as a truck delivery problem. 
The objective is to find a path of minimum cost among those that guarantee a certain probability 
of arriving on time. 

On both problems, we use independent distributions and model them as elements of the 
lattice ordered monoid (M, *, <st)- The resources of Problem ()13l) therefore belong to M, and those 
of Problem (I14h to M x M endowed with the product sum and order. As we focus on instances with 
positive resources, Theorems [11(b), [5l and [6] ensure respectively the convergence of the generalized 
A*, label correcting, and label dominance algorithm. 


road square 




long 



wide 



Figure 6. Stochastic Shortest Path Problem with generic distributions and (3 = 0.05 

Instances. We build instances by generating resources on the road, square grid, long grid, and wide 
grid digraphs introduced in Section jUJ We have generated generic discrete distributions with finite 
support as follows. First, the length of the arcs are rescaled to be non greater than 200. Second, their 

26 































support size is chosen as 10 plus a random integer between 0 and the scaled length of the arc. For 
each t in the support, a weight P(^ = t) is randomly chosen using a uniform distribution on [ 0 , 1 ] for 
each t. The distributions P is then normalized to obtain a probability distribution P. The measure 
is then normalized to obtain a probability distribution. The probability functionals P(- > r) 
and CVaR^ have been tested for different values of r and j3. We have chosen r as follows: a first 
parameter is chosen between 0 and 1 , then r is chosen as the smallest t such that P( 6 o > t) < 
where is the bound provided by the bounding algorithm for the origin vertex o. It enables to 
obtain a threshold r such that the P(^p > r) ~ where is the resource of an optimal path. 
To choose the parameter a, we use the same technique as the one we used in Section [ 6 ] to choose 

the parameter w*: we set a = max ^P (X^aePc ^a. > t) , {YlaePc + IP(Z]aePp /^) ’ 

where Pc is an o-d path P with minimum and Pp is an o-d path P with minimum 

IP(EaeP^a>T). 


For both problems, numerical experiments on the same digraphs but with truncated and dis¬ 
cretized lognormal distributions are available in 71[. The performances of the algorithms with 
these distributions are similar. 

Experimental setting. On medium and large instances, the order of magnitude of the number of 
non-zero terms in the support of ^ is a few thousands. Storing the resources therefore requires more 
memory than in the usual RCSP case. We have therefore set a maximum size of le -|- 04 for the list 
of candidate paths L. To avoid spending too much time in the convolution products, we compute 
them using a Fast Fourier Transform. To that purpose, we use the Fast Fourier Transform C++ 
library kissFFT [l^. Concerning the computation of lower bounds, we use the generalized Dijkstra 
algorithm of Section 15.21 We use ^ !-+■ E(|) as key function (j) when solving Problem ()13p . and 
(w,^) I—>■ w -|-E(^) when solving Problem (I14p . 

Non-constrained problem. Figure [ 6 ] and Table [5] provide numerical results for Problem (I13p with 
/3 = 0.05. They can be read like the figures and tables of Section [H This non-constrained stochastic 
problem is fairly easy to solve: large instances are solved in reasonable time. The main limit on 
the size of the instances we can solve is the memory needed to solve the instance. On Figure [ 6 l we 
can see that our three algorithms exhibit similar performances in terms of computing time needed. 
In Table [5l we can see that these similar CPU time recover totally different realities. The label 
dominance algorithm enumerates hundreds of thousands of paths when the two other algorithms 
enumerate at most a few thousands. We can see in the proportion of paths cut by the dominance 
test in the label correcting algorithm the explanation: the lower bound test cut paths much better 
than the dominance test in that setting. This enables the generalized A* and the label correcting 
algorithm to tackle with larger instances than the label dominance algorithm. The similar CPU 
time we obtain at the end come from the fact that the preprocessing time needed to compute the 
lower bounds is rather long. We also note that, on this non-constrained problem, the key plays 
an important role in the performance of the generalized A* and the label correcting algorithm. 
Indeed, the versions of the algorithms with the key c{xp) instead of c{xp (B b^), identified by the 
suffix K in Table [5] exhibit much poorer performances. On difficult instances, candidate paths are 
an important element of the performance of the generalized A* algorithms. Finally, the numerical 
results confirm that the choice of the expectation of ^ as key in the bounding algorithm is relevant: 
the parameter 7 of Equation (lllj) remains small. 

Constrained problem. Figure [7] and Table [ 6 ] are the analogues of Figure [ 6 ] and Table [5] for Problem 
(HI- This constrained problem is much more difficult than the non constrained one. The relative 
behaviour of the algorithms is quite similar to the one we observe on the usual resource constrained 
shortest path problem (1121) with /c = 10 constraints. The label correcting and the generalized A* 
algorithms behave much better than the label dominance algorithm. Using candidate paths enable 
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Instance 

1^1 

1^1 

Alg. 

7 

Preproc. 

Ext. 

Cut. 

Dom. 

e 

Gap 

CPU (s) 

road50 

50000 

138112 

A* 

1 

74% 

5044 

0 

- 

- 

oo 

3.15e+01 




A* CP 

1 

65%-L34% 

281 

610 

- 

468 

opt 

3.27e+01 




A* K 

1 

80% 

7330 

0 

- 

- 

oo 

2.91e-L01 




cor. 

1 

91% 

1648 

3135 

4% 

468 

opt 

2.63e-L01 




cor. CP 

1 

64%-F35% 

281 

610 

0 % 

468 

opt 

3.49e-L01 




cor. K 

1 

25% 

147208 

97207 

100 % 

- 

oo 

9.69e-L01 




dom. 

- 

- 

147208 

97207 

- 

- 

oo 

1.74e-L01 




dom. CP 

- 

- -L14% 

147208 

97207 

- 

469 

140.3% 

7.84e-L01 

square 200 

40002 

120200 

A* 

1 

82% 

2801 

5800 

- 

261 

opt 

1 . 22 e +01 




A* CP 

1 

60%-L39% 

194 

576 

- 

261 

opt 

1.54e+01 




A* K 

1 

82% 

4903 

0 

- 

- 

oo 

1.27e-L01 




cor. 

1 

92% 

1162 

2488 

1 % 

261 

opt 

1.14e-L01 




cor. CP 

1 

60%-L39% 

194 

576 

0 % 

261 

opt 

1.53e-L01 




cor. K 

1 

22 % 

147641 

97640 

100 % 

- 

oo 

4.64e-l-01 




dom. 

- 

- 

147641 

97640 

- 

- 

oo 

1.09e-L01 




dom. CP 

- 

- +5% 

423004 

280038 

- 

261 

opt 

1.18e-L02 

long50 

12802 

38416 

A* 

1 

36% 

4995 

0 

- 

- 

oo 

2.07e-L01 




A* CP 

1 

52%-L35% 

591 

1172 

- 

1014 

opt 

1.28e+01 




A* K 

1 

57% 

4995 

0 

- 

- 

oo 

1.32e+01 




cor. 

1 

34% 

5427 

288 

100 % 

- 

oo 

2.18e+01 




cor. CP 

1 

52%-L35% 

591 

1172 

0 % 

1014 

opt 

1.29e+01 




cor. K 

1 

6 % 

148493 

98492 

100 % 

- 

oo 

1.34e+02 




dom. 

- 

- 

148493 

98492 

- 

- 

oo 

2.28e-L01 




dom. CP 

- 

-+4% 

148493 

98492 

- 

1018 

112 . 6 % 

1 . 21 e-L 02 

widelOO 

25602 

78400 

A* 

1 

98% 

20 

1638 

- 

20 

opt 

2.48e-L00 




A* CP 

1 

61%-F38% 

1 

1591 

- 

20 

opt 

3.60e-L00 




A* K 

1 

76% 

4203 

0 

- 

- 

oo 

3.17e+00 




cor. 

1 

98% 

20 

1638 

0 % 

20 

opt 

2.46e+00 




cor. CP 

1 

61%-L38% 

1 

1591 

0 % 

20 

opt 

3.59e+00 




cor. K 

1 

39% 

46003 

27868 

100 % 

- 

oo 

6.26e+00 




dom. 

- 

- 

46003 

27868 

- 

- 

oo 

1.56e+00 




dom. CP 

- 

- -L28% 

46003 

27868 

- 

20 

33.3% 

5.22e-L00 


Table 5. Stochastic shortest path problem with generic distributions and j3 = 0.05. 


to speed-up the algorithms on difficult instances. The key in the enumeration algorithm is less 
important than for the non-constrained problem. 

8. What to do on difficult problems 

We have noted in Section [ 6 ] that the performance of the algorithms decreases with the number 
of constraints. To illustrate what happens, we plot on Figure [ 8 ] the resources x = G of 

the usual resource constrained shortest path problem (jl2[) with k = 1 constraint. Each symbol x 
corresponds to the the resource xp of a path P. Figure [81(a) illustrates why the performance of 
the dominance test decreases with the dimension. All it takes is one coordinate such that Wp ^ w^p 

for P not to dominate P. When the number of coordinates increases, it becomes rare that a 
path dominates another, and the dominance test does not enable to cut well paths. Figure [81(b) 
illustrates the fact that the lower bound on the resource of all the v-d paths P must be non- 
greater than the meet /\xp of the resources of the v-d paths, illustrated by the red diamond on 
the figure. When the dimension increases, the gap between /\xp and the resources xp tends to 
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Figure 7. Stochastic Resource Constrained Shortest Path Problem with generic distributions 


increase, and the quality of the bounds decreases. However, a bound can still be computed, 
which explains the reasonably good performance of the algorithms using the lower bound test (Low) 
when the dimension increases. 


w 


w 


Xp 

X 


-XXp 


w 


(b) 


Axp 


w 


Figure 8. Dominance and lower bound tests when dimension increases. On Figure 
(b), each symbol x corresponds to the resource of a v-d path. 

Suppose that for each vertex v, we have a set of resources in TZ such that, for each v-d path 
P, there exists a resource b G By satisfying b ^ xp. We can then replace the lower bound test by 
the following clustered lower bounds test. 

(Clu) Is there a bound b in By such that p{xp 0 6 ) = 0 and c{xp © 6 ) < c^J^ ? 
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Instance 

1^1 

|A| 

Alg. 

7 

Preproc. 

Ext. 

Cut. 

Dom. 

e 

Gap 

CPU (s) 

road20 

20000 

55180 

A* 

1.4 

11 % 

79249 

166646 

- 

240 

opt 

7.21e+01 




A* CP 

1.4 

9%+3% 

79207 

166575 

- 

240 

opt 

8.54e+01 




A* K 

1.4 

3% 

314771 

669005 

- 

- 

CX) 

2.87e+02 




cor. 

1.4 

88 % 

1544 

2647 

9% 

240 

opt 

9.07e+00 




cor. CP 

1.4 

66%+24% 

1502 

2576 

9% 

240 

opt 

1.15e+01 




cor. K 

1.4 

76% 

3538 

6105 

9% 

240 

opt 

1.07e+01 




dom. 

- 

- 

113537 

63535 

- 

- 

CX) 

1.26e+01 




dom. CP 

- 

- +7% 

113537 

63535 

- 

- 

CX 

3.28e+01 

square200 

40002 

120200 

A* 

1.5 

20 % 

87822 

165841 

- 

- 

CX 

7.10e+01 




A* CP 

1.5 

15%+7% 

87822 

165841 

- 

255 

51.3% 

8.91e+01 




A* K 

1.5 

19% 

95221 

180639 

- 

- 

CX 

7.65e+01 




cor. 

1.5 

40% 

30302 

50233 

11 % 

255 

opt 

3.42e+01 




cor. CP 

1.5 

31%+14% 

30301 

50234 

11 % 

255 

opt 

4.31e+01 




cor. K 

1.5 

40% 

32288 

53435 

11 % 

255 

opt 

3.65e+01 




dom. 

- 

- 

37691 

21859 

- 

- 

CX 

1.92e+00 




dom. CP 

- 

- +72% 

37691 

21859 

- 

- 

CX 

6.17e+00 

long20 

5122 

15376 

A* 

1.5 

3% 

115855 

221722 

- 

- 

CX 

8.42e+01 




A* CP 

1.5 

2 %+l% 

115855 

221722 

- 

395 

67.0% 

1.04e+02 




A* K 

1.5 

2 % 

128449 

246911 

- 

- 

CX 

9.43e+01 




cor. 

1.5 

3% 

62412 

99413 

12 % 

- 

CX 

7.27e+01 




cor. CP 

1.5 

2 %+l% 

62412 

99413 

12 % 

395 

7.4% 

9.00e+01 




cor. K 

1.5 

3% 

62800 

99675 

13% 

- 

CX 

7.49e+01 




dom. 

- 

- 

140783 

90781 

- 

- 

CX 

1.80e+01 




dom. CP 

- 

-+4% 

140783 

90781 

- 

- 

CX 

1.79e+01 

widelOO 

25602 

78400 

A* 

1 

99% 

55 

1705 

- 

21 

opt 

1.99e+00 




A* CP 

1 

65%+34% 

47 

1692 

- 

21 

opt 

2.83e+00 




A* K 

1 

99% 

68 

1731 

- 

21 

opt 

2 .02e+00 




cor. 

1 

99% 

45 

1683 

0 % 

21 

opt 

1.97e+00 




cor. CP 

1 

66%+34% 

37 

1670 

0 % 

21 

opt 

2.83e+00 




cor. K 

1 

99% 

54 

1701 

0 % 

21 

opt 

2 .01e+00 




dom. 

- 

- 

8631 

2939 

- 

- 

CX 

3.34e-01 




dom. CP 

- 

- +71% 

8631 

2939 

- 

- 

CX 

1.18e+00 


Table 6 . Stochastic resource constrained shortest path problem with generic distributions. 


The idea behind this new test is illustrated on Figure [9l (a), where the lower bounds b By are 
represented by blue circles. If we partition the v-d paths into clusters of paths with “similar” 
resources, these lower bounds b ^ By are much tighter than /\xp, and thus enable to discard more 
paths. We can also replace the key c{xp 0 by) by min{c(xp 0 6)|6 G By, p{xp 0 6 ) = 0}, which is a 
better approximation of the minimum cost of a feasible o-d path starting by P. 

Figure [91(b) illustrates another idea to improve the quality of the bounds. Consider the usual 
resource constrained shortest path problem with k constraints of Equation (I12p . An o-v path P can 
be a subpath of an optimal path only if there exists a feasible v-d path Q such that vJq < 

Thus, instead of a bound by on the resources of all the v-d paths, we can use a bound by on the 
resource of the v-d paths Q such that Wq < — Wp. If is not too large, we can expect the 

set of such paths Q to be much smaller than the complete set of v-d paths, and thus by to be larger 

than by. 

We now formalize this idea. We assume to have a weight morphism u from [TZ, 0, ^) to (M, +, <) 
such that there is no cycle C of negative weight As w is a morphism, we have 

(jj{xp) = X^agpw(xa). Moreover, we assume to have a scalar such that uj{xp) > implies 
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Figure 9. Lower bounds on clusters of paths (a) and conditional lower bounds (b). 


that P is not an optimal feasible path. Note that such a scalar always exists if the set of optimal 
paths is finite, which is always the case if we consider only elementary paths. For each vertex v in 
V, let Uy be an integer, and col < lo^ < ... < a;”” < ^ = +00 be a sequence of real 

numbers such that ul is the minimum weight of a v-d path, which is well defined because there is no 
cycle of negative weight. Finally, for each vertex v, we suppose to have a set of bounds bl,..., 6”” 
such that bl is a lower bound on the resource of any v-d path P such that uj{xp) < We can 

now define the conditional lower bounds test. 

/p X Do we have p{xp © 6^) = 0 and c{xp © bl) < , where i is the minimum index such 

that 0 ;*"'“^ > — oj{xp) ? 

We can also replace the key c(xp©6„) by c(xp©6^), where i is defined as in the test. When the cost 
function c is a morphism, we can use it as w, and as . This is for instances the case of the 
usual resource constrained shortest path problem (fT^ . and of the stochastic resource constrained 
shortest path problem ()14p . An alternative choice for Problem (jl4|) would be w : (w,^) i—)• lE(^). 

We can adapt the proofs of Theorems [1] and [5] to show that they remain true if we replace the 
lower bound test (Low) by the clustered lower bounds test (Clu) or the conditional lower bounds 
test (Con) 0]. After a brief overview of the technique that enables to build the sets of bounds 
required by both tests, we detail the relative advantages of each of them, and we conclude with 
numerical experiments showing the gain they enable. 


Remark 6 . Provided that we are able to build the bounds any isotone function tv : TZ ^ R can 
be used in the conditional lower bounds test. However, our technique to build the bounds U 
only when a; is a morphism. 


* works 


8.1. Computing the sets of bounds. It is not required to define new bounding algorithms to 
compute the lower bounds set of the clustered lower bound test. Our strategy to compute the lower 
bounds By is to blow-up the digraph D = (H, A) in a much larger digraph V = (V,w4.), and to use 
the algorithm of Section [5] in D. Digraphs V and V are respectively illustrated on the left and on 
the right part of Figure [TOl We provide here the properties of V that enable to retrieve the bounds 
By from the blown-up digraph D. These properties are enforced when V is built. The procedures 
we provide in to build such a graph D are not difficult but technical: we therefore refer the 
interested reader to the Chapter 6 of 71]. 

We denote i? the vertices of V. We have a surjective mapping cp that associates to each vertex 
■d of V a vertex (^( 1 ?) in V. We denote ip~^{v) the set of vertices 1 ? such that fi'd) = v. There are 
typically many vertices in ip~^{v), the only exception being the set ip~^{d) of vertices corresponding 
to the destination d, which is the singleton { 1 ?^}. We deduce from tp a mapping 9 from the set of 
paths TT in P ending in to the set of paths in P in d. We define the resources of the arcs in A 
is such a way that the resource Xjr of a path vr is equal to the resource xp of the corresponding 
path P = 9{7r) in D. The most important assumption is the following one: the mapping 9 induces 
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a bijection between the ip ^{v)-ip ^{d) paths in V and the v-d paths in D, where a ip ^{v)-(p ^{d) 
path is a path between a vertex G ip~^{v) and dd- 



Figure 10. Blown-up graph. <y9 is a surjective mapping between vertices, and 9 a 
bijective mapping between paths. 


As we illustrate on Figure [TOl under these assumptions, the bijection 9 provides a natural par¬ 
tition the set v-d paths P into clusters. The cluster of a v-d path P is given by the origin vertex 
d of the corresponding path tt = 9~^{P). To illustrate this partition in terms of lower bounds on 
resources, the red diamond on Figure [9j (a) is the a lower bound on the resource all the v-d path 
in P, and the blue circles are the lower bounds on the resource of all the d-dd paths in P for each 
d in (f>~^{d). Practically, in the same way we use the algorithm of Equation ([7]) to compute the 
lower bounds b^* or bl on the resource of all the v-d paths in D, we can now use these algorithm 
in digraph P to obtain the lower bounds b^ or 6^ on the resources of all the d-dd paths. As 9 
induces a bijection, for each v-d path P, there is a vertex d G ip~^{v) and a d-dd path tt such that 
6^ ^ bd ^ = xp. We can therefore use G or G as lower bounds 

set in the clustered lower bounds test. 

The bounds of the conditional graph can also be computed using a similar “blown-up graph” 
approach. In both case, the procedure building graph P takes as input the maximum cardinal k of 
(p~^{v). Parameter k corresponds to the maximum number of bounds we obtain for a given vertex 
v- \B^\ < K for the clustered lower bounds test, and the maximum < k for the conditional lower 
bounds test. See Chapter 6 of [711] for more details. 


8.2. When to use the clustered and the conditional lower bound test. The clustered and 
conditional lower bounds tests (Clu) and (Con) are stronger versions of the lower bound test (Low) 
which require a longer preprocessing but enable to reduce the number of paths enumerated by 
the generalized A* and label correcting algorithms. They are therefore not interesting on easy 
instances, where even the preprocessing for the lower bound test (Low) is a waste of time. On 
the contrary, they are interesting on difficult instances where the time spent in the enumeration is 
much larger than the one spent in the preprocessing, and even more interesting on very difficult 
instances that we cannot solve to optimality because the list L becomes to large. 

Increasing the size of P increases the preprocessing time and reduces the number of paths enu¬ 
merated by and the time spent in the enumeration algorithms. On instances that cannot be solved 
to optimality, we advise to use the largest graph P that can be stored in the memory. On instances 
that can be solved to optimality, we advise to choose the size of P in order to spend about the 
same time in the preprocessing and in the enumeration algorithm. 

Clustered and conditional lower bound tests have both their pros and cons. The clustered lower 
bound test can in theory be applied to any instance of the Monoid Resource Constrained 
Shortest Path Problem. Indeed, the procedures that build the digraph P only requires a 
similarity measure that enable to compare two resources x and x. Besides, as we can see on Figure 
m the bounds it produces tend to be tighter than those produced by the conditional lower bound 
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test. Its first drawback comes from the fact that, each time a test (Clu) is performed at a vertex 
V, up to \B^\ operations ©, c(-), and p(-) must be performed, which can be time consuming. The 
other drawbacks are linked to the procedure we use to build the bounds B^. Indeed, this procedure 
calls a clustering subroutine for each vertex v of the digraph D 7l| , which is time consuming when 
P is large. Finally, our procedure that builds V has been thought for acyclic digraphs. We have 
extended it to digraphs with cycles, but the quality of the bounds returned is mitigated. 

Due to these properties, the clustered lower bound approach works particularly well in the context 
of column generation if the pricing subproblem is a resource constrained shortest path problem on 
an acyclic digraph. This is often the case when the problem solved by column generation is a 
vehicle or a crew scheduling problem. Along a column generation scheme, many instances of the 
same resource constrained shortest path problem must be solved successively, the only difference 
between two instances being the reduced costs. Hence, we can compute once and for all the 
digraph P in a (time-consuming) pre-processing, and then use it to compute the lower bound sets 
By and speed-up the resolutions of all the instances of the pricing subproblem. We have applied 
this technique to a column generation approach to the airline crew pairing problem. As it can be 
seen in Table 9.2 of the use of the clustered lower bound test within a generalized A* or a 
label correcting algorithm enables to divide by three the total time spent in the column generation 
scheme on some industrial instances. 

Compared to the clustered lower bound test, the main advantage of the conditional lower bound 
test is that operations ©, c(-), and p{-) need to be performed only once when a test (Con) is 
performed. Its main drawback is that a morphism w is required, which reduces the number of 
problems to which it can be applied. 

The performance of the test depends on the choice of cu. If the set of o-d paths P such that 
^{xp) < is much smaller than the set of o-d paths, then the conditional lower bound test 
tends to exhibit good performances. 


8.3. Numerical results. We now test the performance of the clustered and conditional lower 
bounds tests on difficult instances of the usual resource constrained shortest path problem (fT^ 
with k = 10. We use the cost as morphism co for the conditional lower bounds test: t<;(x) = 
where x = {w^,... ,w^). When we build the sets of bounds By or the conditional bounds 6*, the 
number of bounds we can take for a given vertex v is practically limited by the memory available. We 
therefore consider the instances long5 and squarebO of Table 0] because they are difficult instances 
of reasonable size, which enables to build large sets of bounds By. The numerical experiments have 
been performed on the same computer as those of Section [6l Both the generalized A* and the 
label correcting algorithms have been tested with the new tests (Clu) and (Con). We have used 
algorithms with candidate paths, as these versions are the most efficient ones on difficult instances. 
In Section [6l in order to have comparable results between algorithms and instances, we have set 
the maximum size of L to le-|-05 because it is the maximum size that could fit in the memory for 
all the instances and all the algorithms. Here, we want to obtain the best possible results with each 
algorithm. For a list L of identical size, the label correcting algorithm requires more memory than 
then generalized A* as it needs to store the lists of non-dominated paths My. We have therefore 
set 2e-|-05 as the of maximum size of L for the label correcting, and 2e-|-06 for the generalized A*. 

The numerical results are available in Table [3 The column “Test” provides the test used, which 
can be the lower bound test (Low), the clustered lower bound test (Clu), or the conditional lower 
bounds test (Con). When the clustered or the conditional lower bound test is used, we provide the 
ratio of the number of vertices in the blown-up digraph T> and in the digraph D: it is is the 
average number of bounds used per vertex v. The percentage of time spent in the preprocessing 
includes the construction of the digraph V, the bounding algorithm in D, and the computation of 
candidate paths. The other columns are identical to those of Table 01 
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Instance 

Alg. 

Test 

|V|/|T| 

7 

Prep. 

Ext. 

Cut. 

Dom. 

i 

Gap 

CPU (s) 

longb 

cor. CP 

(Low) 

- 

2.2 

0% 

230b37 

130784 

50% 

81 

60.8% 

7.61e+00 



(Con) 

1.8e+01 

2.2 

6% 

167283 

60966 

82% 

81 

60.0% 

4.91e+00 




1.7e+02 

2.6 

41% 

137348 

24960 

100% 

81 

32.2% 

8.14e+00 




9.1e+02 

1 

73% 

133873 

22666 

100% 

81 

29.2% 

2.05e+01 



(Cln) 

1.7e+01 

1.7 

17% 

190bb9 

88647 

52% 

81 

55.9% 

1.17e+01 




8.2e+01 

1.8 

22% 

187b68 

83110 

55% 

81 

53.4% 

2.54e+01 




3.86-|-02 

1.8 

3b% 

190368 

86960 

55% 

81 

49.5% 

9.85e+01 


A* CP 

(Low) 

- 

2.2 

0% 

1424776 

849563 

- 

81 

64.4% 

9.49e+00 



(Con) 

1.8e+01 

2.2 

2% 

1011810 

23631 

- 

81 

62.3% 

1.41e+01 




1.7e+02 

2.6 

16% 

1000137 

285 

- 

81 

31.0% 

2.32e+01 




9.1e+02 

1 

37% 

1000309 

629 

- 

81 

27.8% 

4.07e+01 



(Cln) 

1.7e+01 

1.8 

6% 

127684b 

553700 

- 

81 

57.9% 

3.45e+01 




8.2e+01 

1.8 

b% 

1218043 

436097 

- 

81 

54.5% 

1.09e+02 




3.86-|-02 

1.8 

7% 

116b819 

331651 

- 

81 

51.7% 

4.35e+02 

squarebO 

cor. CP 

(Low) 

- 

2.2 

0% 

3b0bb3 

273819 

42% 

52 

44.9% 

1.15e+01 



(Con) 

9.7e+00 

2.2 

6% 

217971 

100571 

67% 

52 

41.1% 

5.61e+00 




8.6e+01 

2.b 

41% 

lb8700 

57177 

53% 

52 

15.1% 

8.85e+00 




4.7e+02 

1 

73% 

16b6b8 

71086 

42% 

52 

12.3% 

2.24e+01 



(Cln) 

1.6e+01 

1.7 

23% 

299643 

207262 

46% 

52 

36.5% 

1.64e+01 




7.4e+01 

1.9 

30% 

28b296 

203651 

41% 

52 

35.4% 

3.32e+01 




3.3e+02 

1.9 

47% 

307779 

231886 

40% 

52 

31.6% 

1.22e+02 


A* CP 

(Low) 

- 

2.2 

0% 

99b4128 

11908301 

- 

52 

44.9% 

5.93e+01 



(Con) 

9.7e+00 

2.2 

1% 

462796b 

1255974 

- 

52 

40.2% 

5.96e+01 




8.6e+01 

2.b 

3% 

6772b42 

5545130 

- 

52 

7.5% 

l.lle+02 




4.7e+02 

1 

3% 

30098620 

60197088 

- 

52 

opt 

4.73e+02 



(Cln) 

1.6e+01 

1.7 

2% 

8426382 

8850810 

- 

52 

34.9% 

1.61e+02 




7.4e+01 

1.8 

2% 

8146176 

8292398 

- 

52 

33.8% 

4.73e+02 




3.36-|-02 

1.9 

3% 

9374162 

10748349 

- 

52 

27.9% 

1.71e+03 


Table 7. Results of clustered and conditional lower bounds tests Problem (1121) with 
k = 10 constraints. List L maximum size is 2e+05 for label correcting algorithm 
and 2e+06 for A* algorithm 


As most algorithms do not solve the instance to optimality, the interesting statistic to evaluate 
the performance of the algorithm is the gap. With each algorithm, both the clustered lower bound 
test and the conditional lower bound test enable to reduce the gap. Indeed, they enable to divide 
by two the gap on the instance long5, and to solve the instance squarebO to optimality. Besides, the 
larger the number of bounds per vertex, i.e., the larger the ratio |^, the smaller is the gap at the 

end. Larger means longer preprocessing. We have been limited by the memory of the computer 
on the choice of the size of V. As, on each algorithm launched, either the instance is not solved to 
optimality, or most of the time is spent in the enumeration algorithm, better performances would 
be obtained with larger digraphs P. 

On our two instances, the conditional lower bounds test performs better than the clustered lower 
bounds test. This is not surprising because instances longb and the squarebO have cycle, and, as 
we already mentioned, our procedure that builds the lower bounds sets By does not work well on 
digraphs with cycles. 

We finish with two statistics that can look surprising. First, the ratio 7 of Equation m is 
equal to 1 on very large graphs P for the conditional lower bound test. This comes from the fact 
that, due to our building procedure, these graphs are acyclic. Second, on the longb instance, the 
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percentage of paths cut by the dominance test increases with the size of T>. This is due to the fact 
that, as the key used is a good approximation, only the promising paths are considered, and thus 
few paths are cut by the lower bound test at the beginning of the algorithm. The lower bound test 
enable to cut paths at the end of the algorithm. As the long5 instance is difficult, the algorithm is 
stopped early, and few paths are cut by this test. On the contrary, on the easier squareSO instance, 
the algorithm is stopped later, and the proportion of paths cut by the dominance test decreases 
when the size of T) increases. 
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